Aug 04 00:00:21.993606 ip-10-0-143-2 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Aug 04 00:00:21.993616 ip-10-0-143-2 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Aug 04 00:00:21.993624 ip-10-0-143-2 systemd[1]: kubelet.service: Failed with result 'resources'.
Aug 04 00:00:21.993841 ip-10-0-143-2 systemd[1]: Failed to start Kubernetes Kubelet.
Aug 04 00:00:32.242735 ip-10-0-143-2 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Aug 04 00:00:32.242752 ip-10-0-143-2 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a5ce675c44074768a27a4231e3bd077d --
Aug 04 00:02:25.728004 ip-10-0-143-2 systemd[1]: Starting Kubernetes Kubelet...
Aug 04 00:02:26.080370 ip-10-0-143-2 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 00:02:26.080370 ip-10-0-143-2 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 04 00:02:26.080370 ip-10-0-143-2 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 00:02:26.080370 ip-10-0-143-2 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 04 00:02:26.080370 ip-10-0-143-2 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 00:02:26.082516 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.082444    2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 04 00:02:26.087010 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.086996    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 00:02:26.087010 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087011    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 00:02:26.087073 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087017    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 00:02:26.087073 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087020    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 00:02:26.087073 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087024    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 00:02:26.087073 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087027    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 00:02:26.087073 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087029    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 00:02:26.087073 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087032    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 00:02:26.087073 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087035    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 00:02:26.087073 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087038    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 00:02:26.087073 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087041    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 00:02:26.087073 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087044    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 00:02:26.087073 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087046    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 00:02:26.087073 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087049    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 00:02:26.087073 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087052    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 00:02:26.087073 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087055    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 00:02:26.087073 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087058    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 00:02:26.087073 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087060    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 00:02:26.087073 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087063    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 00:02:26.087073 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087065    2556 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 00:02:26.087073 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087069    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 00:02:26.087073 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087071    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 00:02:26.087530 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087074    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 00:02:26.087530 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087076    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 00:02:26.087530 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087079    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 00:02:26.087530 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087082    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 00:02:26.087530 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087085    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 00:02:26.087530 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087090    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 00:02:26.087530 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087093    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 00:02:26.087530 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087097    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 00:02:26.087530 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087099    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 00:02:26.087530 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087102    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 00:02:26.087530 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087105    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 00:02:26.087530 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087108    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 00:02:26.087530 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087110    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 00:02:26.087530 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087113    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 00:02:26.087530 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087116    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 00:02:26.087530 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087118    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 00:02:26.087530 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087121    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 00:02:26.087530 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087124    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 00:02:26.087530 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087126    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 00:02:26.087990 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087128    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 00:02:26.087990 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087131    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 00:02:26.087990 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087133    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 00:02:26.087990 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087136    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 00:02:26.087990 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087138    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 00:02:26.087990 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087141    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 00:02:26.087990 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087143    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 00:02:26.087990 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087145    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 00:02:26.087990 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087148    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 00:02:26.087990 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087150    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 00:02:26.087990 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087152    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 00:02:26.087990 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087155    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 00:02:26.087990 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087157    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 00:02:26.087990 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087160    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 00:02:26.087990 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087163    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 00:02:26.087990 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087165    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 00:02:26.087990 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087168    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 00:02:26.087990 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087170    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 00:02:26.087990 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087173    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 00:02:26.087990 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087175    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 00:02:26.088479 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087177    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 00:02:26.088479 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087180    2556 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 00:02:26.088479 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087182    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 00:02:26.088479 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087184    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 00:02:26.088479 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087187    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 00:02:26.088479 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087189    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 00:02:26.088479 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087192    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 00:02:26.088479 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087194    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 00:02:26.088479 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087196    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 00:02:26.088479 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087198    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 00:02:26.088479 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087201    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 00:02:26.088479 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087204    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 00:02:26.088479 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087207    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 00:02:26.088479 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087209    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 00:02:26.088479 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087211    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 00:02:26.088479 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087214    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 00:02:26.088479 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087216    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 00:02:26.088479 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087218    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 00:02:26.088479 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087221    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 00:02:26.088479 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087223    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 00:02:26.088978 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087225    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 00:02:26.088978 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087228    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 00:02:26.088978 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087231    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 00:02:26.088978 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087233    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 00:02:26.088978 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087236    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 00:02:26.088978 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087239    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 00:02:26.088978 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087243    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 00:02:26.088978 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087245    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 00:02:26.088978 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087248    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 00:02:26.088978 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087250    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 00:02:26.088978 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087253    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 00:02:26.088978 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087255    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 00:02:26.088978 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087258    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 00:02:26.088978 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087260    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 00:02:26.088978 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087263    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 00:02:26.088978 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087266    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 00:02:26.088978 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087270    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 00:02:26.088978 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087273    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 00:02:26.088978 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087957    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 00:02:26.088978 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087965    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 00:02:26.089455 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087968    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 00:02:26.089455 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087971    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 00:02:26.089455 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087974    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 00:02:26.089455 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087978    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 00:02:26.089455 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087981    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 00:02:26.089455 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087983    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 00:02:26.089455 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087986    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 00:02:26.089455 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087989    2556 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 00:02:26.089455 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087992    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 00:02:26.089455 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087995    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 00:02:26.089455 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.087998    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 00:02:26.089455 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088001    2556 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 00:02:26.089455 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088004    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 00:02:26.089455 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088006    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 00:02:26.089455 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088009    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 00:02:26.089455 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088012    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 00:02:26.089455 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088014    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 00:02:26.089455 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088017    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 00:02:26.089455 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088020    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 00:02:26.089455 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088024    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 00:02:26.089455 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088026    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 00:02:26.089989 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088029    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 00:02:26.089989 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088032    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 00:02:26.089989 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088034    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 00:02:26.089989 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088037    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 00:02:26.089989 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088039    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 00:02:26.089989 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088042    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 00:02:26.089989 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088044    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 00:02:26.089989 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088047    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 00:02:26.089989 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088050    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 00:02:26.089989 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088052    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 00:02:26.089989 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088054    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 00:02:26.089989 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088057    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 00:02:26.089989 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088059    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 00:02:26.089989 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088062    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 00:02:26.089989 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088064    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 00:02:26.089989 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088067    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 00:02:26.089989 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088069    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 00:02:26.089989 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088072    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 00:02:26.089989 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088074    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 00:02:26.089989 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088077    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 00:02:26.090448 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088079    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 00:02:26.090448 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088081    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 00:02:26.090448 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088084    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 00:02:26.090448 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088086    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 00:02:26.090448 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088088    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 00:02:26.090448 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088091    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 00:02:26.090448 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088093    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 00:02:26.090448 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088096    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 00:02:26.090448 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088099    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 00:02:26.090448 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088103    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 00:02:26.090448 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088107    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 00:02:26.090448 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088110    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 00:02:26.090448 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088113    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 00:02:26.090448 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088116    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 00:02:26.090448 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088118    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 00:02:26.090448 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088121    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 00:02:26.090448 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088124    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 00:02:26.090448 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088126    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 00:02:26.090448 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088129    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 00:02:26.090915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088132    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 00:02:26.090915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088135    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 00:02:26.090915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088137    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 00:02:26.090915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088140    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 00:02:26.090915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088142    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 00:02:26.090915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088144    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 00:02:26.090915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088147    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 00:02:26.090915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088149    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 00:02:26.090915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088152    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 00:02:26.090915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088155    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 00:02:26.090915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088157    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 00:02:26.090915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088159    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 00:02:26.090915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088163    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 00:02:26.090915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088165    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 00:02:26.090915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088169    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 00:02:26.090915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088172    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 00:02:26.090915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088175    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 00:02:26.090915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088178    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 00:02:26.090915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088180    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 00:02:26.091406 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088182    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 00:02:26.091406 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088185    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 00:02:26.091406 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088187    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 00:02:26.091406 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088190    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 00:02:26.091406 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088192    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 00:02:26.091406 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088196    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 00:02:26.091406 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088198    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 00:02:26.091406 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088201    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 00:02:26.091406 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088203    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 00:02:26.091406 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088206    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 00:02:26.091406 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088210    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 00:02:26.091406 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088213    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 00:02:26.091406 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088216    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 00:02:26.091406 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088219    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 00:02:26.091406 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088221    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 00:02:26.091406 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088223    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 00:02:26.091406 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088226    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 00:02:26.091406 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088228    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 00:02:26.091406 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088628    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 00:02:26.091878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088633    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 00:02:26.091878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088636    2556 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 00:02:26.091878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088639    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 00:02:26.091878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088642    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 00:02:26.091878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088645    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 00:02:26.091878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088648    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 00:02:26.091878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088651    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 00:02:26.091878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088654    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 00:02:26.091878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088657    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 00:02:26.091878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088659    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 00:02:26.091878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088662    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 00:02:26.091878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088664    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 00:02:26.091878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088668    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 00:02:26.091878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088670    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 00:02:26.091878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088673    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 00:02:26.091878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088677    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 00:02:26.091878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088679    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 00:02:26.091878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088682    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 00:02:26.091878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088684    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 00:02:26.091878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088687    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 00:02:26.092377 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088690    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 00:02:26.092377 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088692    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 00:02:26.092377 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088695    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 00:02:26.092377 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088697    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 00:02:26.092377 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088700    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 00:02:26.092377 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088702    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 00:02:26.092377 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088705    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 00:02:26.092377 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088707    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 00:02:26.092377 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088710    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 00:02:26.092377 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088725    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 00:02:26.092377 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088728    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 00:02:26.092377 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088730    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 00:02:26.092377 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088733    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 00:02:26.092377 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088736    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 00:02:26.092377 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088739    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 00:02:26.092377 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088742    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 00:02:26.092377 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088745    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 00:02:26.092377 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088748    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 00:02:26.092377 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088751    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 00:02:26.092377 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088754    2556 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 00:02:26.092915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088756    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 00:02:26.092915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088759    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 00:02:26.092915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088761    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 00:02:26.092915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088764    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 00:02:26.092915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088767    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 00:02:26.092915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088770    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 00:02:26.092915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088772    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 00:02:26.092915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088775    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 00:02:26.092915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088777    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 00:02:26.092915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088780    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 00:02:26.092915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088782    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 00:02:26.092915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088787    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 00:02:26.092915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088790    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 00:02:26.092915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088793    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 00:02:26.092915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088796    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 00:02:26.092915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088799    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 00:02:26.092915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088802    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 00:02:26.092915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088804    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 00:02:26.092915 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088807    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 00:02:26.093397 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088811    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 00:02:26.093397 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088813    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 00:02:26.093397 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088816    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 00:02:26.093397 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088819    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 00:02:26.093397 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088821    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 00:02:26.093397 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088824    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 00:02:26.093397 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088826    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 00:02:26.093397 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088829    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 00:02:26.093397 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088832    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 00:02:26.093397 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088835    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 00:02:26.093397 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088838    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 00:02:26.093397 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088841    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 00:02:26.093397 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088844    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 00:02:26.093397 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088847    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 00:02:26.093397 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088849    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 00:02:26.093397 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088852    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 00:02:26.093397 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088855    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 00:02:26.093397 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088857    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 00:02:26.093397 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088860    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 00:02:26.093878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088862    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 00:02:26.093878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088865    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 00:02:26.093878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088867    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 00:02:26.093878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088870    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 00:02:26.093878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088872    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 00:02:26.093878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088875    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 00:02:26.093878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088878    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 00:02:26.093878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088880    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 00:02:26.093878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088883    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 00:02:26.093878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088887    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 00:02:26.093878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088890    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 00:02:26.093878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088894    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 00:02:26.093878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088898    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 00:02:26.093878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088901    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 00:02:26.093878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088903    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 00:02:26.093878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088906    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 00:02:26.093878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088909    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 00:02:26.093878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088912    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 00:02:26.093878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088915    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 00:02:26.093878 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.088917    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 00:02:26.094378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.088982    2556 flags.go:64] FLAG: --address="0.0.0.0"
Aug 04 00:02:26.094378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.088989    2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 04 00:02:26.094378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.088994    2556 flags.go:64] FLAG: --anonymous-auth="true"
Aug 04 00:02:26.094378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.088999    2556 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 04 00:02:26.094378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089008    2556 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 04 00:02:26.094378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089011    2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 04 00:02:26.094378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089015    2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 04 00:02:26.094378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089019    2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 04 00:02:26.094378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089022    2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 04 00:02:26.094378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089025    2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 04 00:02:26.094378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089029    2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 04 00:02:26.094378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089033    2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 04 00:02:26.094378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089036    2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 04 00:02:26.094378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089039    2556 flags.go:64] FLAG: --cgroup-root=""
Aug 04 00:02:26.094378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089042    2556 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 04 00:02:26.094378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089045    2556 flags.go:64] FLAG: --client-ca-file=""
Aug 04 00:02:26.094378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089048    2556 flags.go:64] FLAG: --cloud-provider="external"
Aug 04 00:02:26.094378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089051    2556 flags.go:64] FLAG: --cluster-dns="[]"
Aug 04 00:02:26.094378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089056    2556 flags.go:64] FLAG: --cluster-domain=""
Aug 04 00:02:26.094378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089059    2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 04 00:02:26.094378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089062    2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 04 00:02:26.094378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089065    2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 04 00:02:26.094378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089069    2556 flags.go:64] FLAG: --container-log-max-files="5"
Aug 04 00:02:26.094378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089072    2556 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089075    2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089078    2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089081    2556 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089084    2556 flags.go:64] FLAG: --contention-profiling="false"
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089087    2556 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089090    2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089093    2556 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089096    2556 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089100    2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089103    2556 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089106    2556 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089109    2556 flags.go:64] FLAG: --enable-load-reader="false"
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089113    2556 flags.go:64] FLAG: --enable-server="true"
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089117    2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089121    2556 flags.go:64] FLAG: --event-burst="100"
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089124    2556 flags.go:64] FLAG: --event-qps="50"
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089127    2556 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089130    2556 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089135    2556 flags.go:64] FLAG: --eviction-hard=""
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089138    2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089141    2556 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089144    2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089147    2556 flags.go:64] FLAG: --eviction-soft=""
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089150    2556 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 04 00:02:26.094971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089153    2556 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 04 00:02:26.095567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089156    2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 04 00:02:26.095567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089159    2556 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 04 00:02:26.095567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089162    2556 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 04 00:02:26.095567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089165    2556 flags.go:64] FLAG: --fail-swap-on="true"
Aug 04 00:02:26.095567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089168    2556 flags.go:64] FLAG: --feature-gates=""
Aug 04 00:02:26.095567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089184    2556 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 04 00:02:26.095567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089188    2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 04 00:02:26.095567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089192    2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 04 00:02:26.095567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089195    2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 04 00:02:26.095567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089198    2556 flags.go:64] FLAG: --healthz-port="10248"
Aug 04 00:02:26.095567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089201    2556 flags.go:64] FLAG: --help="false"
Aug 04 00:02:26.095567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089204    2556 flags.go:64] FLAG: --hostname-override="ip-10-0-143-2.ec2.internal"
Aug 04 00:02:26.095567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089208    2556 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 04 00:02:26.095567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089211    2556 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 04 00:02:26.095567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089213    2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 04 00:02:26.095567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089217    2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 04 00:02:26.095567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089220    2556 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 04 00:02:26.095567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089223    2556 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 04 00:02:26.095567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089226    2556 flags.go:64] FLAG: --image-service-endpoint=""
Aug 04 00:02:26.095567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089230    2556 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 04 00:02:26.095567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089233    2556 flags.go:64] FLAG: --kube-api-burst="100"
Aug 04 00:02:26.095567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089237    2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 04 00:02:26.095567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089240    2556 flags.go:64] FLAG: --kube-api-qps="50"
Aug 04 00:02:26.095567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089243    2556 flags.go:64] FLAG: --kube-reserved=""
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089247    2556 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089250    2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089254    2556 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089257    2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089259    2556 flags.go:64] FLAG: --lock-file=""
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089262    2556 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089265    2556 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089268    2556 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089273    2556 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089276    2556 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089279    2556 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089282    2556 flags.go:64] FLAG: --logging-format="text"
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089284    2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089288    2556 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089291    2556 flags.go:64] FLAG: --manifest-url=""
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089294    2556 flags.go:64] FLAG: --manifest-url-header=""
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089298    2556 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089301    2556 flags.go:64] FLAG: --max-open-files="1000000"
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089309    2556 flags.go:64] FLAG: --max-pods="110"
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089312    2556 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089315    2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089318    2556 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089321    2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089324    2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 04 00:02:26.096155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089327    2556 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089330    2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089337    2556 flags.go:64] FLAG: --node-status-max-images="50"
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089341    2556 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089345    2556 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089348    2556 flags.go:64] FLAG: --pod-cidr=""
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089351    2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089356    2556 flags.go:64] FLAG: --pod-manifest-path=""
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089359    2556 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089363    2556 flags.go:64] FLAG: --pods-per-core="0"
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089368    2556 flags.go:64] FLAG: --port="10250"
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089371    2556 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089374    2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0825b1a93fc0c8ba7"
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089377    2556 flags.go:64] FLAG: --qos-reserved=""
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089380    2556 flags.go:64] FLAG: --read-only-port="10255"
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089383    2556 flags.go:64] FLAG: --register-node="true"
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089386    2556 flags.go:64] FLAG: --register-with-taints=""
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089389    2556 flags.go:64] FLAG: --registry-burst="10"
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089392    2556 flags.go:64] FLAG: --registry-qps="5"
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089395    2556 flags.go:64] FLAG: --reserved-cpus=""
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089398    2556 flags.go:64] FLAG: --reserved-memory=""
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089401    2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089404    2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089407    2556 flags.go:64] FLAG: --rotate-certificates="false"
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089410    2556 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 04 00:02:26.096802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089413    2556 flags.go:64] FLAG: --runonce="false"
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089416    2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089419    2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089422    2556 flags.go:64] FLAG: --seccomp-default="false"
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089424    2556 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089427    2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089430    2556 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089434    2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089437    2556 flags.go:64] FLAG: --storage-driver-password="root"
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089439    2556 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089444    2556 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089447    2556 flags.go:64] FLAG: --storage-driver-user="root"
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089450    2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089453    2556 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089457    2556 flags.go:64] FLAG: --system-cgroups=""
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089460    2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089465    2556 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089469    2556 flags.go:64] FLAG: --tls-cert-file=""
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089472    2556 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089477    2556 flags.go:64] FLAG: --tls-min-version=""
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089479    2556 flags.go:64] FLAG: --tls-private-key-file=""
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089482    2556 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089485    2556 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089501    2556 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089504    2556 flags.go:64] FLAG: --v="2"
Aug 04 00:02:26.097441 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089508    2556 flags.go:64] FLAG: --version="false"
Aug 04 00:02:26.098098 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089511    2556 flags.go:64] FLAG: --vmodule=""
Aug 04 00:02:26.098098 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089515    2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 04 00:02:26.098098 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089518    2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 04 00:02:26.098098 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089630    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 00:02:26.098098 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089633    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 00:02:26.098098 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089636    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 00:02:26.098098 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089639    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 00:02:26.098098 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089642    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 00:02:26.098098 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089645    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 00:02:26.098098 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089647    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 00:02:26.098098 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089650    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 00:02:26.098098 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089652    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 00:02:26.098098 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089655    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 00:02:26.098098 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089659    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 00:02:26.098098 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089662    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 00:02:26.098098 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089666    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 00:02:26.098098 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089670    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 00:02:26.098098 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089673    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 00:02:26.098098 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089676    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 00:02:26.098554 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089679    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 00:02:26.098554 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089683    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 00:02:26.098554 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089686    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 00:02:26.098554 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089689    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 00:02:26.098554 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089693    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 00:02:26.098554 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089696    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 00:02:26.098554 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089698    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 00:02:26.098554 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089701    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 00:02:26.098554 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089703    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 00:02:26.098554 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089706    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 00:02:26.098554 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089708    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 00:02:26.098554 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089723    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 00:02:26.098554 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089726    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 00:02:26.098554 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089729    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 00:02:26.098554 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089732    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 00:02:26.098554 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089734    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 00:02:26.098554 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089737    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 00:02:26.098554 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089739    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 00:02:26.098554 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089742    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 00:02:26.099017 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089745    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 00:02:26.099017 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089747    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 00:02:26.099017 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089750    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 00:02:26.099017 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089752    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 00:02:26.099017 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089755    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 00:02:26.099017 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089758    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 00:02:26.099017 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089760    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 00:02:26.099017 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089763    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 00:02:26.099017 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089767    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 00:02:26.099017 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089770    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 00:02:26.099017 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089774    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 00:02:26.099017 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089777    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 00:02:26.099017 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089779    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 00:02:26.099017 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089782    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 00:02:26.099017 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089784    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 00:02:26.099017 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089787    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 00:02:26.099017 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089790    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 00:02:26.099017 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089795    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 00:02:26.099017 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089797    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 00:02:26.099464 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089800    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 00:02:26.099464 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089802    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 00:02:26.099464 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089805    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 00:02:26.099464 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089807    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 00:02:26.099464 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089810    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 00:02:26.099464 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089812    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 00:02:26.099464 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089814    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 00:02:26.099464 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089817    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 00:02:26.099464 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089820    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 00:02:26.099464 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089822    2556 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 00:02:26.099464 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089824    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 00:02:26.099464 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089827    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 00:02:26.099464 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089829    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 00:02:26.099464 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089832    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 00:02:26.099464 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089834    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 00:02:26.099464 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089837    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 00:02:26.099464 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089839    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 00:02:26.099464 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089842    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 00:02:26.099464 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089844    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 00:02:26.099464 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089847    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 00:02:26.099952 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089849    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 00:02:26.099952 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089851    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 00:02:26.099952 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089854    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 00:02:26.099952 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089857    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 00:02:26.099952 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089860    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 00:02:26.099952 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089863    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 00:02:26.099952 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089865    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 00:02:26.099952 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089867    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 00:02:26.099952 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089870    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 00:02:26.099952 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089872    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 00:02:26.099952 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089877    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 00:02:26.099952 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089880    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 00:02:26.099952 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089882    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 00:02:26.099952 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089885    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 00:02:26.099952 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089887    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 00:02:26.099952 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089890    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 00:02:26.099952 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089892    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 00:02:26.099952 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089894    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 00:02:26.099952 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089897    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 00:02:26.099952 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089899    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 00:02:26.100454 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089902    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 00:02:26.100454 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089904    2556 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 00:02:26.100454 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089907    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 00:02:26.100454 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089909    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 00:02:26.100454 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.089912    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 00:02:26.100454 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.089917    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 00:02:26.100454 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.096774    2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 04 00:02:26.100454 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.096791    2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 04 00:02:26.100454 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.097747    2556 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 04 00:02:26.100454 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.097757    2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 04 00:02:26.100454 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097832    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 00:02:26.100454 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097838    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 00:02:26.100454 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097841    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 00:02:26.100454 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097844    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 00:02:26.100454 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097847    2556 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 00:02:26.100838 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097850    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 00:02:26.100838 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097852    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 00:02:26.100838 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097855    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 00:02:26.100838 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097858    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 00:02:26.100838 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097860    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 00:02:26.100838 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097863    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 00:02:26.100838 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097865    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 00:02:26.100838 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097868    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 00:02:26.100838 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097870    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 00:02:26.100838 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097873    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 00:02:26.100838 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097876    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 00:02:26.100838 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097879    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 00:02:26.100838 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097881    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 00:02:26.100838 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097884    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 00:02:26.100838 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097887    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 00:02:26.100838 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097889    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 00:02:26.100838 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097892    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 00:02:26.100838 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097894    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 00:02:26.100838 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097896    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 00:02:26.100838 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097899    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 00:02:26.101330 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097902    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 00:02:26.101330 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097904    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 00:02:26.101330 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097907    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 00:02:26.101330 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097910    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 00:02:26.101330 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097920    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 00:02:26.101330 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097924    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 00:02:26.101330 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097927    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 00:02:26.101330 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097930    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 00:02:26.101330 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097932    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 00:02:26.101330 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097935    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 00:02:26.101330 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097937    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 00:02:26.101330 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097940    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 00:02:26.101330 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097944    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 00:02:26.101330 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097947    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 00:02:26.101330 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097950    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 00:02:26.101330 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097953    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 00:02:26.101330 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097956    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 00:02:26.101330 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097959    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 00:02:26.101330 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097962    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 00:02:26.101814 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097964    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 00:02:26.101814 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097967    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 00:02:26.101814 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097969    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 00:02:26.101814 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097972    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 00:02:26.101814 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097975    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 00:02:26.101814 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097977    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 00:02:26.101814 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097980    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 00:02:26.101814 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097983    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 00:02:26.101814 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097985    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 00:02:26.101814 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097988    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 00:02:26.101814 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097990    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 00:02:26.101814 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097993    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 00:02:26.101814 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097995    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 00:02:26.101814 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.097998    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 00:02:26.101814 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098000    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 00:02:26.101814 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098002    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 00:02:26.101814 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098005    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 00:02:26.101814 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098009    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 00:02:26.101814 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098017    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 00:02:26.102276 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098020    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 00:02:26.102276 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098022    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 00:02:26.102276 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098024    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 00:02:26.102276 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098027    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 00:02:26.102276 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098029    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 00:02:26.102276 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098032    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 00:02:26.102276 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098034    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 00:02:26.102276 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098037    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 00:02:26.102276 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098039    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 00:02:26.102276 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098041    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 00:02:26.102276 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098044    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 00:02:26.102276 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098046    2556 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 00:02:26.102276 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098049    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 00:02:26.102276 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098051    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 00:02:26.102276 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098053    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 00:02:26.102276 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098056    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 00:02:26.102276 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098059    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 00:02:26.102276 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098062    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 00:02:26.102276 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098064    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 00:02:26.102276 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098067    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 00:02:26.102751 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098069    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 00:02:26.102751 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098072    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 00:02:26.102751 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098074    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 00:02:26.102751 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098077    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 00:02:26.102751 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098079    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 00:02:26.102751 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098081    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 00:02:26.102751 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098085    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 00:02:26.102751 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098088    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 00:02:26.102751 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098091    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 00:02:26.102751 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098094    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 00:02:26.102751 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098097    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 00:02:26.102751 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098100    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 00:02:26.102751 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098108    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 00:02:26.102751 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098111    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 00:02:26.102751 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098114    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 00:02:26.102751 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098116    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 00:02:26.103126 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.098121    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 00:02:26.103126 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098267    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 00:02:26.103126 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098272    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 00:02:26.103126 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098275    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 00:02:26.103126 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098278    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 00:02:26.103126 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098282    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 00:02:26.103126 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098285    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 00:02:26.103126 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098288    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 00:02:26.103126 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098291    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 00:02:26.103126 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098293    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 00:02:26.103126 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098296    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 00:02:26.103126 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098299    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 00:02:26.103126 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098302    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 00:02:26.103126 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098304    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 00:02:26.103126 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098307    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 00:02:26.103485 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098309    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 00:02:26.103485 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098312    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 00:02:26.103485 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098314    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 00:02:26.103485 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098317    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 00:02:26.103485 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098319    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 00:02:26.103485 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098321    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 00:02:26.103485 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098324    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 00:02:26.103485 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098326    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 00:02:26.103485 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098329    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 00:02:26.103485 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098331    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 00:02:26.103485 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098333    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 00:02:26.103485 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098336    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 00:02:26.103485 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098339    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 00:02:26.103485 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098341    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 00:02:26.103485 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098349    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 00:02:26.103485 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098352    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 00:02:26.103485 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098354    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 00:02:26.103485 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098357    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 00:02:26.103485 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098359    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 00:02:26.103485 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098362    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 00:02:26.103963 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098364    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 00:02:26.103963 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098372    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 00:02:26.103963 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098374    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 00:02:26.103963 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098377    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 00:02:26.103963 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098379    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 00:02:26.103963 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098382    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 00:02:26.103963 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098384    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 00:02:26.103963 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098387    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 00:02:26.103963 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098391    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 00:02:26.103963 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098394    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 00:02:26.103963 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098397    2556 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 00:02:26.103963 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098400    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 00:02:26.103963 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098403    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 00:02:26.103963 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098405    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 00:02:26.103963 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098408    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 00:02:26.103963 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098411    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 00:02:26.103963 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098413    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 00:02:26.103963 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098416    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 00:02:26.103963 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098418    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 00:02:26.104436 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098420    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 00:02:26.104436 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098423    2556 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 00:02:26.104436 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098425    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 00:02:26.104436 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098428    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 00:02:26.104436 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098430    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 00:02:26.104436 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098433    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 00:02:26.104436 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098435    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 00:02:26.104436 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098438    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 00:02:26.104436 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098446    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 00:02:26.104436 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098448    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 00:02:26.104436 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098451    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 00:02:26.104436 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098453    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 00:02:26.104436 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098456    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 00:02:26.104436 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098458    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 00:02:26.104436 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098461    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 00:02:26.104436 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098463    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 00:02:26.104436 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098466    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 00:02:26.104436 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098468    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 00:02:26.104436 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098470    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 00:02:26.104966 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098473    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 00:02:26.104966 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098475    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 00:02:26.104966 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098478    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 00:02:26.104966 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098481    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 00:02:26.104966 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098484    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 00:02:26.104966 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098488    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 00:02:26.104966 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098490    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 00:02:26.104966 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098493    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 00:02:26.104966 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098496    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 00:02:26.104966 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098498    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 00:02:26.104966 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098501    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 00:02:26.104966 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098503    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 00:02:26.104966 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098506    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 00:02:26.104966 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098508    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 00:02:26.104966 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098511    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 00:02:26.104966 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098513    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 00:02:26.104966 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098516    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 00:02:26.104966 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098518    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 00:02:26.104966 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098521    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 00:02:26.104966 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098524    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 00:02:26.105433 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098526    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 00:02:26.105433 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098528    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 00:02:26.105433 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098537    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 00:02:26.105433 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098540    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 00:02:26.105433 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098543    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 00:02:26.105433 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098545    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 00:02:26.105433 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:26.098547    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 00:02:26.105433 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.098552    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 00:02:26.105433 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.098683    2556 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 04 00:02:26.105433 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.101797    2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 04 00:02:26.105433 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.102964    2556 server.go:1019] "Starting client certificate rotation"
Aug 04 00:02:26.105433 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.103057    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 00:02:26.105433 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.103096    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 00:02:26.105777 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.105185    2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 00:02:26.110202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.110180    2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 00:02:26.124009 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.123992    2556 log.go:25] "Validated CRI v1 runtime API"
Aug 04 00:02:26.125938 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.125922    2556 log.go:25] "Validated CRI v1 image API"
Aug 04 00:02:26.127090 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.127070    2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 04 00:02:26.129089 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.129068    2556 fs.go:135] Filesystem UUIDs: map[09657cd5-b750-4d03-907c-5d6e5326b480:/dev/nvme0n1p3 6fd1ccb0-9bf7-4523-b19c-883edc44070b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Aug 04 00:02:26.129148 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.129088    2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 04 00:02:26.133926 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.133911    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 00:02:26.134256 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.134154    2556 manager.go:216] Machine: {Timestamp:2026-08-04 00:02:26.132899911 +0000 UTC m=+0.301537271 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3164614 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ee29ecb13d435f200f1857021ed8f SystemUUID:ec2ee29e-cb13-d435-f200-f1857021ed8f BootID:a5ce675c-4407-4768-a27a-4231e3bd077d Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5f:d1:8b:8c:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5f:d1:8b:8c:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:83:9d:b6:d6:a1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 04 00:02:26.134256 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.134253    2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 04 00:02:26.134338 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.134323    2556 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 04 00:02:26.136029 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.136004    2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 04 00:02:26.136161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.136033    2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-2.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 04 00:02:26.136724 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.136704    2556 topology_manager.go:138] "Creating topology manager with none policy"
Aug 04 00:02:26.136764 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.136728    2556 container_manager_linux.go:309] "Creating device plugin manager"
Aug 04 00:02:26.136764 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.136736    2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 00:02:26.137385 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.137374    2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 00:02:26.138063 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.138054    2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 04 00:02:26.141537 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.141525    2556 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 00:02:26.141659 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.141650    2556 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 04 00:02:26.141686 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.141679    2556 kubelet.go:486] "Attempting to sync node with API server"
Aug 04 00:02:26.141723 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.141695    2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 04 00:02:26.141723 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.141708    2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 04 00:02:26.141783 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.141730    2556 kubelet.go:398] "Adding apiserver pod source"
Aug 04 00:02:26.141814 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.141792    2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 04 00:02:26.142153 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.142140    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 00:02:26.142210 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.142160    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 00:02:26.143978 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.143957    2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 04 00:02:26.145663 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.145650    2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 04 00:02:26.145738 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.145678    2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 04 00:02:26.146852 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.146840    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 04 00:02:26.146895 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.146856    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 04 00:02:26.146895 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.146863    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 04 00:02:26.146895 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.146868    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 04 00:02:26.146895 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.146877    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 04 00:02:26.146895 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.146882    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 04 00:02:26.146895 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.146890    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 04 00:02:26.146895 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.146896    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 04 00:02:26.147075 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.146904    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 04 00:02:26.147075 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.146909    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 04 00:02:26.147075 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.146918    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 04 00:02:26.147075 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.146923    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 04 00:02:26.147652 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.147639    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 04 00:02:26.147652 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.147651    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 04 00:02:26.150880 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.150867    2556 server.go:1268] "Started kubelet"
Aug 04 00:02:26.150989 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.150950    2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 04 00:02:26.151058 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.151004    2556 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 04 00:02:26.151554 ip-10-0-143-2 systemd[1]: Started Kubernetes Kubelet.
Aug 04 00:02:26.154088 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.154056    2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 04 00:02:26.154244 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.154221    2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 04 00:02:26.154327 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:26.154296    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 04 00:02:26.154520 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.154498    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9c9rl"
Aug 04 00:02:26.154578 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:26.154526    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-2.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 04 00:02:26.155078 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.154385    2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-2.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 04 00:02:26.156549 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:26.156514    2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 04 00:02:26.156770 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.156759    2556 server.go:310] "Adding debug handlers to kubelet server"
Aug 04 00:02:26.159678 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:26.158876    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-2.ec2.internal.18c87139fe97d417  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-2.ec2.internal,UID:ip-10-0-143-2.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-2.ec2.internal,},FirstTimestamp:2026-08-04 00:02:26.150839319 +0000 UTC m=+0.319476679,LastTimestamp:2026-08-04 00:02:26.150839319 +0000 UTC m=+0.319476679,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-2.ec2.internal,}"
Aug 04 00:02:26.160870 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.160853    2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 04 00:02:26.160939 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.160872    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 04 00:02:26.160999 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:26.160967    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-2.ec2.internal\" not found"
Aug 04 00:02:26.161459 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.161309    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9c9rl"
Aug 04 00:02:26.161459 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.161362    2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 04 00:02:26.161589 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.161484    2556 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 04 00:02:26.161589 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.161560    2556 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 04 00:02:26.161733 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.161693    2556 reconstruct.go:97] "Volume reconstruction finished"
Aug 04 00:02:26.161733 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.161700    2556 factory.go:55] Registering systemd factory
Aug 04 00:02:26.161733 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.161731    2556 factory.go:223] Registration of the systemd container factory successfully
Aug 04 00:02:26.161894 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.161704    2556 reconciler.go:29] "Reconciler: start to sync state"
Aug 04 00:02:26.162002 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.161986    2556 factory.go:153] Registering CRI-O factory
Aug 04 00:02:26.162038 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.162004    2556 factory.go:223] Registration of the crio container factory successfully
Aug 04 00:02:26.162070 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.162054    2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 04 00:02:26.162105 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.162081    2556 factory.go:103] Registering Raw factory
Aug 04 00:02:26.162105 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.162100    2556 manager.go:1196] Started watching for new ooms in manager
Aug 04 00:02:26.162755 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.162737    2556 manager.go:349] Starting recovery of all containers
Aug 04 00:02:26.170846 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.170828    2556 manager.go:354] Recovery completed
Aug 04 00:02:26.171232 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.171215    2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 00:02:26.173669 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:26.173544    2556 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-2.ec2.internal\" not found" node="ip-10-0-143-2.ec2.internal"
Aug 04 00:02:26.175760 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.175706    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 00:02:26.178297 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.178281    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-2.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 00:02:26.178344 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.178308    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-2.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 00:02:26.178344 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.178323    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-2.ec2.internal" event="NodeHasSufficientPID"
Aug 04 00:02:26.178844 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.178830    2556 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 04 00:02:26.178844 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.178842    2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 04 00:02:26.178950 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.178857    2556 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 00:02:26.178950 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.178868    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 00:02:26.179545 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.179530    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-2.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 00:02:26.179606 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.179559    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-2.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 00:02:26.179606 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.179573    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-2.ec2.internal" event="NodeHasSufficientPID"
Aug 04 00:02:26.179907 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.179897    2556 policy_none.go:49] "None policy: Start"
Aug 04 00:02:26.179951 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.179910    2556 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 04 00:02:26.179951 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.179920    2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 04 00:02:26.180872 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.180860    2556 policy_none.go:47] "Start"
Aug 04 00:02:26.226307 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.226203    2556 manager.go:337] "Starting Device Plugin manager"
Aug 04 00:02:26.226391 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:26.226339    2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 04 00:02:26.226391 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.226354    2556 server.go:87] "Starting device plugin registration server"
Aug 04 00:02:26.226532 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.226521    2556 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 04 00:02:26.226582 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.226532    2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 04 00:02:26.226648 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.226626    2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 04 00:02:26.226743 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.226730    2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 04 00:02:26.226743 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.226743    2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 04 00:02:26.227157 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:26.227136    2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 04 00:02:26.227233 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:26.227191    2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-2.ec2.internal\" not found"
Aug 04 00:02:26.299689 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.299661    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 04 00:02:26.300779 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.300733    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 04 00:02:26.300779 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.300764    2556 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 04 00:02:26.300779 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.300783    2556 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 04 00:02:26.300947 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:26.300811    2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 04 00:02:26.303185 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.303171    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 00:02:26.327112 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.327096    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 00:02:26.327813 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.327795    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-2.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 00:02:26.327885 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.327827    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-2.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 00:02:26.327885 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.327839    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-2.ec2.internal" event="NodeHasSufficientPID"
Aug 04 00:02:26.327885 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.327865    2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-2.ec2.internal"
Aug 04 00:02:26.335443 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.335409    2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-2.ec2.internal"
Aug 04 00:02:26.335443 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:26.335428    2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-2.ec2.internal\": node \"ip-10-0-143-2.ec2.internal\" not found"
Aug 04 00:02:26.349520 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:26.349501    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-2.ec2.internal\" not found"
Aug 04 00:02:26.401782 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.401750    2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-2.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-2.ec2.internal"]
Aug 04 00:02:26.401861 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.401838    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 00:02:26.402636 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.402620    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-2.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 00:02:26.402714 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.402640    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-2.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 00:02:26.402714 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.402650    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-2.ec2.internal" event="NodeHasSufficientPID"
Aug 04 00:02:26.403940 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.403928    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 00:02:26.404053 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.404039    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-2.ec2.internal"
Aug 04 00:02:26.404087 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.404070    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 00:02:26.404633 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.404611    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-2.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 00:02:26.404633 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.404622    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-2.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 00:02:26.404793 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.404640    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-2.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 00:02:26.404793 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.404645    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-2.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 00:02:26.404793 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.404651    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-2.ec2.internal" event="NodeHasSufficientPID"
Aug 04 00:02:26.404793 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.404659    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-2.ec2.internal" event="NodeHasSufficientPID"
Aug 04 00:02:26.406529 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.406512    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-2.ec2.internal"
Aug 04 00:02:26.406616 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.406542    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 00:02:26.407196 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.407183    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-2.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 00:02:26.407260 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.407206    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-2.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 00:02:26.407260 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.407216    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-2.ec2.internal" event="NodeHasSufficientPID"
Aug 04 00:02:26.429424 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:26.429401    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-2.ec2.internal\" not found" node="ip-10-0-143-2.ec2.internal"
Aug 04 00:02:26.433590 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:26.433575    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-2.ec2.internal\" not found" node="ip-10-0-143-2.ec2.internal"
Aug 04 00:02:26.450368 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:26.450348    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-2.ec2.internal\" not found"
Aug 04 00:02:26.552657 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:26.552636    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-2.ec2.internal\" not found"
Aug 04 00:02:26.562499 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.562480    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/904e03550f1156d10a235812f1eccc8d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-2.ec2.internal\" (UID: \"904e03550f1156d10a235812f1eccc8d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-2.ec2.internal"
Aug 04 00:02:26.562563 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.562506    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/60020f9b08eeb842b087b428d24d6e5c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-2.ec2.internal\" (UID: \"60020f9b08eeb842b087b428d24d6e5c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-2.ec2.internal"
Aug 04 00:02:26.562563 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.562523    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/904e03550f1156d10a235812f1eccc8d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-2.ec2.internal\" (UID: \"904e03550f1156d10a235812f1eccc8d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-2.ec2.internal"
Aug 04 00:02:26.652975 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:26.652906    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-2.ec2.internal\" not found"
Aug 04 00:02:26.662695 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.662675    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/904e03550f1156d10a235812f1eccc8d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-2.ec2.internal\" (UID: \"904e03550f1156d10a235812f1eccc8d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-2.ec2.internal"
Aug 04 00:02:26.662762 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.662701    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/904e03550f1156d10a235812f1eccc8d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-2.ec2.internal\" (UID: \"904e03550f1156d10a235812f1eccc8d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-2.ec2.internal"
Aug 04 00:02:26.662762 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.662737    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/60020f9b08eeb842b087b428d24d6e5c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-2.ec2.internal\" (UID: \"60020f9b08eeb842b087b428d24d6e5c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-2.ec2.internal"
Aug 04 00:02:26.662839 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.662788    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/904e03550f1156d10a235812f1eccc8d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-2.ec2.internal\" (UID: \"904e03550f1156d10a235812f1eccc8d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-2.ec2.internal"
Aug 04 00:02:26.662839 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.662802    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/904e03550f1156d10a235812f1eccc8d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-2.ec2.internal\" (UID: \"904e03550f1156d10a235812f1eccc8d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-2.ec2.internal"
Aug 04 00:02:26.662906 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.662788    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/60020f9b08eeb842b087b428d24d6e5c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-2.ec2.internal\" (UID: \"60020f9b08eeb842b087b428d24d6e5c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-2.ec2.internal"
Aug 04 00:02:26.734956 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.734923    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-2.ec2.internal"
Aug 04 00:02:26.736089 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:26.736075    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-2.ec2.internal"
Aug 04 00:02:26.753693 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:26.753674    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-2.ec2.internal\" not found"
Aug 04 00:02:26.857007 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:26.856963    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-2.ec2.internal\" not found"
Aug 04 00:02:26.958000 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:26.957934    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-2.ec2.internal\" not found"
Aug 04 00:02:27.058456 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:27.058421    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-2.ec2.internal\" not found"
Aug 04 00:02:27.075148 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.075132    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 00:02:27.103632 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.103606    2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 04 00:02:27.104042 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.103752    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 00:02:27.104042 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.103778    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 00:02:27.104042 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.103786    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 00:02:27.143037 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.142994    2556 apiserver.go:52] "Watching apiserver"
Aug 04 00:02:27.159878 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.159858    2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 04 00:02:27.160244 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.160222    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-k84m6","openshift-ovn-kubernetes/ovnkube-node-7mbxb","kube-system/global-pull-secret-syncer-hw9ff","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m","openshift-dns/node-resolver-g8zpg","openshift-multus/multus-additional-cni-plugins-sxn7d","kube-system/konnectivity-agent-4wgvp","openshift-cluster-node-tuning-operator/tuned-9sv72","openshift-image-registry/node-ca-zw2l8","openshift-multus/multus-sk5gb","openshift-multus/network-metrics-daemon-wx48v","openshift-network-diagnostics/network-check-target-xqvmz"]
Aug 04 00:02:27.161049 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.161030    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-2.ec2.internal"
Aug 04 00:02:27.161152 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.161057    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 04 00:02:27.161771 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.161705    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k84m6"
Aug 04 00:02:27.163820 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.163796    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.165036 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.165008    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 04 00:02:27.166543 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.165668    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-etc-openvswitch\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.166543 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.165742    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-run-openvswitch\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.166543 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.165868    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-host-cni-bin\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.166543 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.165857    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-02 23:57:26 +0000 UTC" deadline="2028-01-31 05:33:04.456609219 +0000 UTC"
Aug 04 00:02:27.166543 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.165909    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13085h30m37.290703539s"
Aug 04 00:02:27.166543 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.165920    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-host-cni-netd\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.166543 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.165964    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c7e62961-9c80-467c-b7ea-0ddd6bcec813-env-overrides\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.166543 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.166025    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-host-kubelet\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.166543 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.166106    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-host-run-netns\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.166543 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.166149    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-run-systemd\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.166543 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.166156    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hftt2\""
Aug 04 00:02:27.166543 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.166187    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 04 00:02:27.166543 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.165967    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 04 00:02:27.166543 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.166186    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c7e62961-9c80-467c-b7ea-0ddd6bcec813-ovnkube-script-lib\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.166543 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.166351    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c0d370f-ee60-44b6-a225-0311447ac802-host-slash\") pod \"iptables-alerter-k84m6\" (UID: \"4c0d370f-ee60-44b6-a225-0311447ac802\") " pod="openshift-network-operator/iptables-alerter-k84m6"
Aug 04 00:02:27.166543 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.166380    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-host-slash\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.166543 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.166415    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-var-lib-openvswitch\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.166543 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.166445    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-run-ovn\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.167736 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.166573    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-log-socket\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.167736 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.166605    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4p4b\" (UniqueName: \"kubernetes.io/projected/c7e62961-9c80-467c-b7ea-0ddd6bcec813-kube-api-access-z4p4b\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.167736 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.166656    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-systemd-units\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.167736 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.166693    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-node-log\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.167736 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.166726    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-host-run-ovn-kubernetes\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.167736 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.166804    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.167736 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.166813    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6jjc9\""
Aug 04 00:02:27.167736 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.166946    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c7e62961-9c80-467c-b7ea-0ddd6bcec813-ovnkube-config\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.167736 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.166989    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c7e62961-9c80-467c-b7ea-0ddd6bcec813-ovn-node-metrics-cert\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.167736 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.167023    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c0d370f-ee60-44b6-a225-0311447ac802-iptables-alerter-script\") pod \"iptables-alerter-k84m6\" (UID: \"4c0d370f-ee60-44b6-a225-0311447ac802\") " pod="openshift-network-operator/iptables-alerter-k84m6"
Aug 04 00:02:27.167736 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.167054    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knmt5\" (UniqueName: \"kubernetes.io/projected/4c0d370f-ee60-44b6-a225-0311447ac802-kube-api-access-knmt5\") pod \"iptables-alerter-k84m6\" (UID: \"4c0d370f-ee60-44b6-a225-0311447ac802\") " pod="openshift-network-operator/iptables-alerter-k84m6"
Aug 04 00:02:27.167736 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.167230    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 04 00:02:27.167736 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.167641    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 04 00:02:27.167736 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.167719    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 04 00:02:27.168502 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.168029    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:27.168502 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:27.168118    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:02:27.168872 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.168840    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m"
Aug 04 00:02:27.169094 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.169075    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 04 00:02:27.169213 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.169193    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 04 00:02:27.170074 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.170052    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 04 00:02:27.170346 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.170327    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g8zpg"
Aug 04 00:02:27.171298 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.171282    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 04 00:02:27.171388 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.171319    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 04 00:02:27.171673 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.171655    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 04 00:02:27.171815 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.171794    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sg6zn\""
Aug 04 00:02:27.171883 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.171803    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.172251 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.172219    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 00:02:27.172378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.172355    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jvbds\""
Aug 04 00:02:27.172563 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.172543    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 04 00:02:27.172652 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.172543    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 04 00:02:27.173207 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.173189    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4wgvp"
Aug 04 00:02:27.174217 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.174193    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 00:02:27.174312 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.174227    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 04 00:02:27.174312 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.174292    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-2.ec2.internal"
Aug 04 00:02:27.174421 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.174338    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b47kz\""
Aug 04 00:02:27.174421 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.174348    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 04 00:02:27.174522 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.174427    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 04 00:02:27.174522 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.174196    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 04 00:02:27.174653 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.174632    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 04 00:02:27.174805 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.174788    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.175254 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.175233    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fhcpj\""
Aug 04 00:02:27.175344 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.175322    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 04 00:02:27.175405 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.175345    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 04 00:02:27.176640 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.176296    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zw2l8"
Aug 04 00:02:27.176884 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.176868    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 04 00:02:27.177029 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.176986    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 04 00:02:27.177181 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.177162    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cp85r\""
Aug 04 00:02:27.178032 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.178016    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.178521 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.178503    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 04 00:02:27.178597 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.178522    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-srwlb\""
Aug 04 00:02:27.178597 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.178524    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 04 00:02:27.178597 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.178545    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 04 00:02:27.179711 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.179692    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:27.179815 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:27.179782    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:02:27.180062 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.180043    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 04 00:02:27.180338 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.180325    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jgv2c\""
Aug 04 00:02:27.180860 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.180846    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-2.ec2.internal"]
Aug 04 00:02:27.180944 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.180935    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:27.181000 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:27.180978    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:02:27.184563 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.184546    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-2.ec2.internal"]
Aug 04 00:02:27.184697 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.184679    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 00:02:27.192449 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.192429    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kmvhs"
Aug 04 00:02:27.200086 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.200069    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kmvhs"
Aug 04 00:02:27.258013 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:27.257984    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904e03550f1156d10a235812f1eccc8d.slice/crio-cea94967d0c012aa357474cc0c5ac72bb2234d7ab0015b4a01d263de3cf314e9 WatchSource:0}: Error finding container cea94967d0c012aa357474cc0c5ac72bb2234d7ab0015b4a01d263de3cf314e9: Status 404 returned error can't find the container with id cea94967d0c012aa357474cc0c5ac72bb2234d7ab0015b4a01d263de3cf314e9
Aug 04 00:02:27.258677 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:27.258657    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60020f9b08eeb842b087b428d24d6e5c.slice/crio-7a0e259ee5a91c0eb0120173161e5dd2b5e4d3e6fd538d63013187b0f825ca98 WatchSource:0}: Error finding container 7a0e259ee5a91c0eb0120173161e5dd2b5e4d3e6fd538d63013187b0f825ca98: Status 404 returned error can't find the container with id 7a0e259ee5a91c0eb0120173161e5dd2b5e4d3e6fd538d63013187b0f825ca98
Aug 04 00:02:27.262309 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.262263    2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 04 00:02:27.264665 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.264649    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 00:02:27.267428 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.267409    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f920924-9925-422d-b1d1-7b423471ffa2-agent-certs\") pod \"konnectivity-agent-4wgvp\" (UID: \"6f920924-9925-422d-b1d1-7b423471ffa2\") " pod="kube-system/konnectivity-agent-4wgvp"
Aug 04 00:02:27.267513 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.267441    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d0e3954b-476e-4ce8-a5e5-9364801153ed-serviceca\") pod \"node-ca-zw2l8\" (UID: \"d0e3954b-476e-4ce8-a5e5-9364801153ed\") " pod="openshift-image-registry/node-ca-zw2l8"
Aug 04 00:02:27.267513 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.267471    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-host-cni-netd\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.267513 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.267496    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c7e62961-9c80-467c-b7ea-0ddd6bcec813-ovnkube-script-lib\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.267667 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.267554    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0311940e-8fe1-4dba-9f40-418274c065cc-tmp-dir\") pod \"node-resolver-g8zpg\" (UID: \"0311940e-8fe1-4dba-9f40-418274c065cc\") " pod="openshift-dns/node-resolver-g8zpg"
Aug 04 00:02:27.267667 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.267561    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-host-cni-netd\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.267667 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.267599    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-multus-cni-dir\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.267915 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.267688    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-etc-systemd\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.267915 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.267714    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-tmp\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.267915 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.267736    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-os-release\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.267915 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.267760    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-host-run-k8s-cni-cncf-io\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.267915 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.267815    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-host-run-netns\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.267915 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.267856    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e-etc-selinux\") pod \"aws-ebs-csi-driver-node-dzq6m\" (UID: \"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m"
Aug 04 00:02:27.267915 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.267877    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a-os-release\") pod \"multus-additional-cni-plugins-sxn7d\" (UID: \"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a\") " pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.267915 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.267894    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-var-lib-kubelet\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.268306 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.267931    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1c75c58e-ca1e-40b0-8993-9a91f8214235-dbus\") pod \"global-pull-secret-syncer-hw9ff\" (UID: \"1c75c58e-ca1e-40b0-8993-9a91f8214235\") " pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:27.268306 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.267965    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c0d370f-ee60-44b6-a225-0311447ac802-host-slash\") pod \"iptables-alerter-k84m6\" (UID: \"4c0d370f-ee60-44b6-a225-0311447ac802\") " pod="openshift-network-operator/iptables-alerter-k84m6"
Aug 04 00:02:27.268306 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.267984    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-var-lib-openvswitch\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.268306 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268011    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-log-socket\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.268306 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268045    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-log-socket\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.268306 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268078    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c0d370f-ee60-44b6-a225-0311447ac802-host-slash\") pod \"iptables-alerter-k84m6\" (UID: \"4c0d370f-ee60-44b6-a225-0311447ac802\") " pod="openshift-network-operator/iptables-alerter-k84m6"
Aug 04 00:02:27.268306 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268082    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/542a9bb2-fa17-4f40-affd-3024a7968ec3-cni-binary-copy\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.268306 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268091    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-var-lib-openvswitch\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.268306 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268126    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-host-var-lib-kubelet\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.268306 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268135    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c7e62961-9c80-467c-b7ea-0ddd6bcec813-ovnkube-script-lib\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.268306 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268145    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6kfl\" (UniqueName: \"kubernetes.io/projected/46d8005c-382d-442b-bdda-ab4af6df878f-kube-api-access-z6kfl\") pod \"network-metrics-daemon-wx48v\" (UID: \"46d8005c-382d-442b-bdda-ab4af6df878f\") " pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:27.268306 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268161    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e-device-dir\") pod \"aws-ebs-csi-driver-node-dzq6m\" (UID: \"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m"
Aug 04 00:02:27.268306 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268201    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-systemd-units\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.268306 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268231    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.268306 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268262    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e-socket-dir\") pod \"aws-ebs-csi-driver-node-dzq6m\" (UID: \"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m"
Aug 04 00:02:27.268306 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268264    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-systemd-units\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.268306 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268288    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a-system-cni-dir\") pod \"multus-additional-cni-plugins-sxn7d\" (UID: \"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a\") " pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.269161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268314    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a-cni-binary-copy\") pod \"multus-additional-cni-plugins-sxn7d\" (UID: \"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a\") " pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.269161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268325    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.269161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268338    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f920924-9925-422d-b1d1-7b423471ffa2-konnectivity-ca\") pod \"konnectivity-agent-4wgvp\" (UID: \"6f920924-9925-422d-b1d1-7b423471ffa2\") " pod="kube-system/konnectivity-agent-4wgvp"
Aug 04 00:02:27.269161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268367    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-etc-sysconfig\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.269161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268389    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-etc-sysctl-d\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.269161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268417    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c0d370f-ee60-44b6-a225-0311447ac802-iptables-alerter-script\") pod \"iptables-alerter-k84m6\" (UID: \"4c0d370f-ee60-44b6-a225-0311447ac802\") " pod="openshift-network-operator/iptables-alerter-k84m6"
Aug 04 00:02:27.269161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268466    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-etc-openvswitch\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.269161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268483    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-run-openvswitch\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.269161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268499    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c7e62961-9c80-467c-b7ea-0ddd6bcec813-env-overrides\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.269161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268515    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-etc-kubernetes\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.269161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268529    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e-registration-dir\") pod \"aws-ebs-csi-driver-node-dzq6m\" (UID: \"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m"
Aug 04 00:02:27.269161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268549    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sxn7d\" (UID: \"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a\") " pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.269161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268567    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-run-openvswitch\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.269161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268575    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-sys\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.269161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268600    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-host-kubelet\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.269161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268608    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-etc-openvswitch\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.269161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268651    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-host-run-netns\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.270149 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268690    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-run-systemd\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.270149 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268700    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-host-kubelet\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.270149 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268718    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-host-run-netns\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.270149 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268752    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-multus-socket-dir-parent\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.270149 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268757    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-run-systemd\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.270149 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268780    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqg4w\" (UniqueName: \"kubernetes.io/projected/542a9bb2-fa17-4f40-affd-3024a7968ec3-kube-api-access-kqg4w\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.270149 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268801    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-host\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.270149 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268822    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-host-slash\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.270149 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268842    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-run-ovn\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.270149 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268865    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4p4b\" (UniqueName: \"kubernetes.io/projected/c7e62961-9c80-467c-b7ea-0ddd6bcec813-kube-api-access-z4p4b\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.270149 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268880    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6knt6\" (UniqueName: \"kubernetes.io/projected/0311940e-8fe1-4dba-9f40-418274c065cc-kube-api-access-6knt6\") pod \"node-resolver-g8zpg\" (UID: \"0311940e-8fe1-4dba-9f40-418274c065cc\") " pod="openshift-dns/node-resolver-g8zpg"
Aug 04 00:02:27.270149 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268896    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-etc-modprobe-d\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.270149 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268877    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-host-slash\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.270149 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268911    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-run-ovn\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.270149 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268913    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-lib-modules\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.270149 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268959    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxhx9\" (UniqueName: \"kubernetes.io/projected/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-kube-api-access-bxhx9\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.270149 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268967    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c0d370f-ee60-44b6-a225-0311447ac802-iptables-alerter-script\") pod \"iptables-alerter-k84m6\" (UID: \"4c0d370f-ee60-44b6-a225-0311447ac802\") " pod="openshift-network-operator/iptables-alerter-k84m6"
Aug 04 00:02:27.271202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268984    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1c75c58e-ca1e-40b0-8993-9a91f8214235-kubelet-config\") pod \"global-pull-secret-syncer-hw9ff\" (UID: \"1c75c58e-ca1e-40b0-8993-9a91f8214235\") " pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:27.271202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.268991    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c7e62961-9c80-467c-b7ea-0ddd6bcec813-env-overrides\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.271202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.269039    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-node-log\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.271202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.269083    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c7e62961-9c80-467c-b7ea-0ddd6bcec813-ovn-node-metrics-cert\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.271202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.269090    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-node-log\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.271202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.269142    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-host-run-multus-certs\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.271202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.269270    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-etc-kubernetes\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.271202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.269303    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-run\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.271202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.269337    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knmt5\" (UniqueName: \"kubernetes.io/projected/4c0d370f-ee60-44b6-a225-0311447ac802-kube-api-access-knmt5\") pod \"iptables-alerter-k84m6\" (UID: \"4c0d370f-ee60-44b6-a225-0311447ac802\") " pod="openshift-network-operator/iptables-alerter-k84m6"
Aug 04 00:02:27.271202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.269361    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-host-cni-bin\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.271202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.269447    2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 04 00:02:27.271202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.269591    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-host-var-lib-cni-bin\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.271202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.269618    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-multus-conf-dir\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.271202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.269647    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-etc-sysctl-conf\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.271202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.269693    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srsgc\" (UniqueName: \"kubernetes.io/projected/d0e3954b-476e-4ce8-a5e5-9364801153ed-kube-api-access-srsgc\") pod \"node-ca-zw2l8\" (UID: \"d0e3954b-476e-4ce8-a5e5-9364801153ed\") " pod="openshift-image-registry/node-ca-zw2l8"
Aug 04 00:02:27.271202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.269721    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-host-var-lib-cni-multus\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.271202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.269783    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-hostroot\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.271845 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.269817    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-host-cni-bin\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.271845 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.269818    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-host-run-ovn-kubernetes\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.271845 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.269896    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e-sys-fs\") pod \"aws-ebs-csi-driver-node-dzq6m\" (UID: \"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m"
Aug 04 00:02:27.271845 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.269863    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7e62961-9c80-467c-b7ea-0ddd6bcec813-host-run-ovn-kubernetes\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.271845 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.269919    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb9l6\" (UniqueName: \"kubernetes.io/projected/ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e-kube-api-access-lb9l6\") pod \"aws-ebs-csi-driver-node-dzq6m\" (UID: \"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m"
Aug 04 00:02:27.271845 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.269940    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6wwx\" (UniqueName: \"kubernetes.io/projected/4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a-kube-api-access-c6wwx\") pod \"multus-additional-cni-plugins-sxn7d\" (UID: \"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a\") " pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.271845 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.269960    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-etc-tuned\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.271845 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.269977    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d0e3954b-476e-4ce8-a5e5-9364801153ed-host\") pod \"node-ca-zw2l8\" (UID: \"d0e3954b-476e-4ce8-a5e5-9364801153ed\") " pod="openshift-image-registry/node-ca-zw2l8"
Aug 04 00:02:27.271845 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.269997    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0311940e-8fe1-4dba-9f40-418274c065cc-hosts-file\") pod \"node-resolver-g8zpg\" (UID: \"0311940e-8fe1-4dba-9f40-418274c065cc\") " pod="openshift-dns/node-resolver-g8zpg"
Aug 04 00:02:27.271845 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.270017    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1c75c58e-ca1e-40b0-8993-9a91f8214235-original-pull-secret\") pod \"global-pull-secret-syncer-hw9ff\" (UID: \"1c75c58e-ca1e-40b0-8993-9a91f8214235\") " pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:27.271845 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.270036    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-cnibin\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.271845 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.270056    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/542a9bb2-fa17-4f40-affd-3024a7968ec3-multus-daemon-config\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.271845 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.270077    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sxn7d\" (UID: \"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a\") " pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.271845 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.270105    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d8005c-382d-442b-bdda-ab4af6df878f-metrics-certs\") pod \"network-metrics-daemon-wx48v\" (UID: \"46d8005c-382d-442b-bdda-ab4af6df878f\") " pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:27.271845 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.270156    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48wjr\" (UniqueName: \"kubernetes.io/projected/d9bc22fa-fb2f-46ee-a049-614b16402835-kube-api-access-48wjr\") pod \"network-check-target-xqvmz\" (UID: \"d9bc22fa-fb2f-46ee-a049-614b16402835\") " pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:27.271845 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.270187    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sxn7d\" (UID: \"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a\") " pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.272355 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.270215    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c7e62961-9c80-467c-b7ea-0ddd6bcec813-ovnkube-config\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.272355 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.270238    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-system-cni-dir\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.272355 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.270262    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dzq6m\" (UID: \"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m"
Aug 04 00:02:27.272355 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.270298    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a-cnibin\") pod \"multus-additional-cni-plugins-sxn7d\" (UID: \"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a\") " pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.272355 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.270729    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c7e62961-9c80-467c-b7ea-0ddd6bcec813-ovnkube-config\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.272560 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.272545    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c7e62961-9c80-467c-b7ea-0ddd6bcec813-ovn-node-metrics-cert\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.277321 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.277299    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knmt5\" (UniqueName: \"kubernetes.io/projected/4c0d370f-ee60-44b6-a225-0311447ac802-kube-api-access-knmt5\") pod \"iptables-alerter-k84m6\" (UID: \"4c0d370f-ee60-44b6-a225-0311447ac802\") " pod="openshift-network-operator/iptables-alerter-k84m6"
Aug 04 00:02:27.278277 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.278258    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4p4b\" (UniqueName: \"kubernetes.io/projected/c7e62961-9c80-467c-b7ea-0ddd6bcec813-kube-api-access-z4p4b\") pod \"ovnkube-node-7mbxb\" (UID: \"c7e62961-9c80-467c-b7ea-0ddd6bcec813\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.303963 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.303921    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-2.ec2.internal" event={"ID":"60020f9b08eeb842b087b428d24d6e5c","Type":"ContainerStarted","Data":"7a0e259ee5a91c0eb0120173161e5dd2b5e4d3e6fd538d63013187b0f825ca98"}
Aug 04 00:02:27.305065 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.305044    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-2.ec2.internal" event={"ID":"904e03550f1156d10a235812f1eccc8d","Type":"ContainerStarted","Data":"cea94967d0c012aa357474cc0c5ac72bb2234d7ab0015b4a01d263de3cf314e9"}
Aug 04 00:02:27.371683 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.371653    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1c75c58e-ca1e-40b0-8993-9a91f8214235-dbus\") pod \"global-pull-secret-syncer-hw9ff\" (UID: \"1c75c58e-ca1e-40b0-8993-9a91f8214235\") " pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:27.371822 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.371688    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/542a9bb2-fa17-4f40-affd-3024a7968ec3-cni-binary-copy\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.371822 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.371711    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-host-var-lib-kubelet\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.371822 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.371750    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6kfl\" (UniqueName: \"kubernetes.io/projected/46d8005c-382d-442b-bdda-ab4af6df878f-kube-api-access-z6kfl\") pod \"network-metrics-daemon-wx48v\" (UID: \"46d8005c-382d-442b-bdda-ab4af6df878f\") " pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:27.371822 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.371773    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e-device-dir\") pod \"aws-ebs-csi-driver-node-dzq6m\" (UID: \"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m"
Aug 04 00:02:27.371822 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.371796    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e-socket-dir\") pod \"aws-ebs-csi-driver-node-dzq6m\" (UID: \"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m"
Aug 04 00:02:27.371822 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.371796    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-host-var-lib-kubelet\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.372060 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.371823    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1c75c58e-ca1e-40b0-8993-9a91f8214235-dbus\") pod \"global-pull-secret-syncer-hw9ff\" (UID: \"1c75c58e-ca1e-40b0-8993-9a91f8214235\") " pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:27.372060 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.371868    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e-device-dir\") pod \"aws-ebs-csi-driver-node-dzq6m\" (UID: \"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m"
Aug 04 00:02:27.372060 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.371933    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e-socket-dir\") pod \"aws-ebs-csi-driver-node-dzq6m\" (UID: \"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m"
Aug 04 00:02:27.372060 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.371932    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a-system-cni-dir\") pod \"multus-additional-cni-plugins-sxn7d\" (UID: \"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a\") " pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.372060 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.371970    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a-system-cni-dir\") pod \"multus-additional-cni-plugins-sxn7d\" (UID: \"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a\") " pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.372060 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.371971    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a-cni-binary-copy\") pod \"multus-additional-cni-plugins-sxn7d\" (UID: \"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a\") " pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.372060 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372007    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f920924-9925-422d-b1d1-7b423471ffa2-konnectivity-ca\") pod \"konnectivity-agent-4wgvp\" (UID: \"6f920924-9925-422d-b1d1-7b423471ffa2\") " pod="kube-system/konnectivity-agent-4wgvp"
Aug 04 00:02:27.372060 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372025    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-etc-sysconfig\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.372060 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372048    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-etc-sysctl-d\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.372490 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372104    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-etc-kubernetes\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.372490 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372115    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-etc-sysconfig\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.372490 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372132    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e-registration-dir\") pod \"aws-ebs-csi-driver-node-dzq6m\" (UID: \"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m"
Aug 04 00:02:27.372490 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372163    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sxn7d\" (UID: \"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a\") " pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.372490 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372164    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-etc-kubernetes\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.372490 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372174    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-etc-sysctl-d\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.372490 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372214    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e-registration-dir\") pod \"aws-ebs-csi-driver-node-dzq6m\" (UID: \"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m"
Aug 04 00:02:27.372490 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372189    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-sys\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.372490 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372264    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/542a9bb2-fa17-4f40-affd-3024a7968ec3-cni-binary-copy\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.372490 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372279    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-multus-socket-dir-parent\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.372490 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372246    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-sys\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.372490 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372309    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqg4w\" (UniqueName: \"kubernetes.io/projected/542a9bb2-fa17-4f40-affd-3024a7968ec3-kube-api-access-kqg4w\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.372490 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372334    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-host\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.372490 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372343    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-multus-socket-dir-parent\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.372490 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372361    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6knt6\" (UniqueName: \"kubernetes.io/projected/0311940e-8fe1-4dba-9f40-418274c065cc-kube-api-access-6knt6\") pod \"node-resolver-g8zpg\" (UID: \"0311940e-8fe1-4dba-9f40-418274c065cc\") " pod="openshift-dns/node-resolver-g8zpg"
Aug 04 00:02:27.372490 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372383    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-etc-modprobe-d\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.372490 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372393    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-host\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.372490 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372408    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-lib-modules\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.373341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372432    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxhx9\" (UniqueName: \"kubernetes.io/projected/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-kube-api-access-bxhx9\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.373341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372456    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1c75c58e-ca1e-40b0-8993-9a91f8214235-kubelet-config\") pod \"global-pull-secret-syncer-hw9ff\" (UID: \"1c75c58e-ca1e-40b0-8993-9a91f8214235\") " pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:27.373341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372481    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-host-run-multus-certs\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.373341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372504    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-etc-kubernetes\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.373341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372520    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1c75c58e-ca1e-40b0-8993-9a91f8214235-kubelet-config\") pod \"global-pull-secret-syncer-hw9ff\" (UID: \"1c75c58e-ca1e-40b0-8993-9a91f8214235\") " pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:27.373341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372526    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-run\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.373341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372482    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-etc-modprobe-d\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.373341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372547    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a-cni-binary-copy\") pod \"multus-additional-cni-plugins-sxn7d\" (UID: \"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a\") " pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.373341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372556    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-host-var-lib-cni-bin\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.373341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372569    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-host-run-multus-certs\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.373341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372573    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f920924-9925-422d-b1d1-7b423471ffa2-konnectivity-ca\") pod \"konnectivity-agent-4wgvp\" (UID: \"6f920924-9925-422d-b1d1-7b423471ffa2\") " pod="kube-system/konnectivity-agent-4wgvp"
Aug 04 00:02:27.373341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372591    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-multus-conf-dir\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.373341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372599    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-host-var-lib-cni-bin\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.373341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372615    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-run\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.373341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372640    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-etc-sysctl-conf\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.373341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372620    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-etc-kubernetes\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.373341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372667    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-multus-conf-dir\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.373341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372668    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srsgc\" (UniqueName: \"kubernetes.io/projected/d0e3954b-476e-4ce8-a5e5-9364801153ed-kube-api-access-srsgc\") pod \"node-ca-zw2l8\" (UID: \"d0e3954b-476e-4ce8-a5e5-9364801153ed\") " pod="openshift-image-registry/node-ca-zw2l8"
Aug 04 00:02:27.374262 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372676    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sxn7d\" (UID: \"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a\") " pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.374262 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372707    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-host-var-lib-cni-multus\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.374262 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372732    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-hostroot\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.374262 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372753    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-lib-modules\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.374262 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372774    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e-sys-fs\") pod \"aws-ebs-csi-driver-node-dzq6m\" (UID: \"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m"
Aug 04 00:02:27.374262 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372778    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-host-var-lib-cni-multus\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.374262 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372772    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-etc-sysctl-conf\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.374262 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372800    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb9l6\" (UniqueName: \"kubernetes.io/projected/ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e-kube-api-access-lb9l6\") pod \"aws-ebs-csi-driver-node-dzq6m\" (UID: \"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m"
Aug 04 00:02:27.374262 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372795    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-hostroot\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.374262 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372830    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6wwx\" (UniqueName: \"kubernetes.io/projected/4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a-kube-api-access-c6wwx\") pod \"multus-additional-cni-plugins-sxn7d\" (UID: \"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a\") " pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.374262 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372807    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e-sys-fs\") pod \"aws-ebs-csi-driver-node-dzq6m\" (UID: \"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m"
Aug 04 00:02:27.374262 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372848    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-etc-tuned\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.374262 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372883    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d0e3954b-476e-4ce8-a5e5-9364801153ed-host\") pod \"node-ca-zw2l8\" (UID: \"d0e3954b-476e-4ce8-a5e5-9364801153ed\") " pod="openshift-image-registry/node-ca-zw2l8"
Aug 04 00:02:27.374262 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372911    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0311940e-8fe1-4dba-9f40-418274c065cc-hosts-file\") pod \"node-resolver-g8zpg\" (UID: \"0311940e-8fe1-4dba-9f40-418274c065cc\") " pod="openshift-dns/node-resolver-g8zpg"
Aug 04 00:02:27.374262 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372938    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1c75c58e-ca1e-40b0-8993-9a91f8214235-original-pull-secret\") pod \"global-pull-secret-syncer-hw9ff\" (UID: \"1c75c58e-ca1e-40b0-8993-9a91f8214235\") " pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:27.374262 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372963    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d0e3954b-476e-4ce8-a5e5-9364801153ed-host\") pod \"node-ca-zw2l8\" (UID: \"d0e3954b-476e-4ce8-a5e5-9364801153ed\") " pod="openshift-image-registry/node-ca-zw2l8"
Aug 04 00:02:27.374262 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.372990    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0311940e-8fe1-4dba-9f40-418274c065cc-hosts-file\") pod \"node-resolver-g8zpg\" (UID: \"0311940e-8fe1-4dba-9f40-418274c065cc\") " pod="openshift-dns/node-resolver-g8zpg"
Aug 04 00:02:27.374262 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373027    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-cnibin\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.374834 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:27.373028    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:27.374834 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373050    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/542a9bb2-fa17-4f40-affd-3024a7968ec3-multus-daemon-config\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.374834 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373072    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sxn7d\" (UID: \"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a\") " pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.374834 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373079    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-cnibin\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.374834 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373100    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d8005c-382d-442b-bdda-ab4af6df878f-metrics-certs\") pod \"network-metrics-daemon-wx48v\" (UID: \"46d8005c-382d-442b-bdda-ab4af6df878f\") " pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:27.374834 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:27.373146    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c75c58e-ca1e-40b0-8993-9a91f8214235-original-pull-secret podName:1c75c58e-ca1e-40b0-8993-9a91f8214235 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:27.873110895 +0000 UTC m=+2.041748248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1c75c58e-ca1e-40b0-8993-9a91f8214235-original-pull-secret") pod "global-pull-secret-syncer-hw9ff" (UID: "1c75c58e-ca1e-40b0-8993-9a91f8214235") : object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:27.374834 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373215    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48wjr\" (UniqueName: \"kubernetes.io/projected/d9bc22fa-fb2f-46ee-a049-614b16402835-kube-api-access-48wjr\") pod \"network-check-target-xqvmz\" (UID: \"d9bc22fa-fb2f-46ee-a049-614b16402835\") " pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:27.374834 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373243    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sxn7d\" (UID: \"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a\") " pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.374834 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:27.373246    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:27.374834 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:27.373313    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46d8005c-382d-442b-bdda-ab4af6df878f-metrics-certs podName:46d8005c-382d-442b-bdda-ab4af6df878f nodeName:}" failed. No retries permitted until 2026-08-04 00:02:27.873297453 +0000 UTC m=+2.041934802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46d8005c-382d-442b-bdda-ab4af6df878f-metrics-certs") pod "network-metrics-daemon-wx48v" (UID: "46d8005c-382d-442b-bdda-ab4af6df878f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:27.374834 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373409    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-system-cni-dir\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.374834 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373425    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sxn7d\" (UID: \"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a\") " pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.374834 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373428    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dzq6m\" (UID: \"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m"
Aug 04 00:02:27.374834 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373462    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dzq6m\" (UID: \"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m"
Aug 04 00:02:27.374834 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373465    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a-cnibin\") pod \"multus-additional-cni-plugins-sxn7d\" (UID: \"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a\") " pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.374834 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373475    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-system-cni-dir\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.375371 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373493    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f920924-9925-422d-b1d1-7b423471ffa2-agent-certs\") pod \"konnectivity-agent-4wgvp\" (UID: \"6f920924-9925-422d-b1d1-7b423471ffa2\") " pod="kube-system/konnectivity-agent-4wgvp"
Aug 04 00:02:27.375371 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373510    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d0e3954b-476e-4ce8-a5e5-9364801153ed-serviceca\") pod \"node-ca-zw2l8\" (UID: \"d0e3954b-476e-4ce8-a5e5-9364801153ed\") " pod="openshift-image-registry/node-ca-zw2l8"
Aug 04 00:02:27.375371 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373524    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a-cnibin\") pod \"multus-additional-cni-plugins-sxn7d\" (UID: \"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a\") " pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.375371 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373529    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0311940e-8fe1-4dba-9f40-418274c065cc-tmp-dir\") pod \"node-resolver-g8zpg\" (UID: \"0311940e-8fe1-4dba-9f40-418274c065cc\") " pod="openshift-dns/node-resolver-g8zpg"
Aug 04 00:02:27.375371 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373580    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sxn7d\" (UID: \"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a\") " pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.375371 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373567    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-multus-cni-dir\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.375371 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373634    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-etc-systemd\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.375371 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373662    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-tmp\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.375371 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373689    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-os-release\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.375371 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373707    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-multus-cni-dir\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.375371 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373715    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-host-run-k8s-cni-cncf-io\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.375371 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373755    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0311940e-8fe1-4dba-9f40-418274c065cc-tmp-dir\") pod \"node-resolver-g8zpg\" (UID: \"0311940e-8fe1-4dba-9f40-418274c065cc\") " pod="openshift-dns/node-resolver-g8zpg"
Aug 04 00:02:27.375371 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373775    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-host-run-netns\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.375371 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373777    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-host-run-k8s-cni-cncf-io\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.375371 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373809    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e-etc-selinux\") pod \"aws-ebs-csi-driver-node-dzq6m\" (UID: \"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m"
Aug 04 00:02:27.375371 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373837    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a-os-release\") pod \"multus-additional-cni-plugins-sxn7d\" (UID: \"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a\") " pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.375371 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373842    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-os-release\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.375371 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373861    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-var-lib-kubelet\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.375903 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373896    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-etc-systemd\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.375903 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373920    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-var-lib-kubelet\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.375903 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373968    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a-os-release\") pod \"multus-additional-cni-plugins-sxn7d\" (UID: \"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a\") " pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.375903 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.373982    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e-etc-selinux\") pod \"aws-ebs-csi-driver-node-dzq6m\" (UID: \"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m"
Aug 04 00:02:27.375903 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.374008    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/542a9bb2-fa17-4f40-affd-3024a7968ec3-host-run-netns\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.375903 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.374010    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d0e3954b-476e-4ce8-a5e5-9364801153ed-serviceca\") pod \"node-ca-zw2l8\" (UID: \"d0e3954b-476e-4ce8-a5e5-9364801153ed\") " pod="openshift-image-registry/node-ca-zw2l8"
Aug 04 00:02:27.375903 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.374162    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/542a9bb2-fa17-4f40-affd-3024a7968ec3-multus-daemon-config\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.375903 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.375178    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-etc-tuned\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.376138 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.376059    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-tmp\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.376215 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.376199    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f920924-9925-422d-b1d1-7b423471ffa2-agent-certs\") pod \"konnectivity-agent-4wgvp\" (UID: \"6f920924-9925-422d-b1d1-7b423471ffa2\") " pod="kube-system/konnectivity-agent-4wgvp"
Aug 04 00:02:27.379963 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:27.379946    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 00:02:27.379963 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:27.379963    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 00:02:27.380096 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:27.379974    2556 projected.go:196] Error preparing data for projected volume kube-api-access-48wjr for pod openshift-network-diagnostics/network-check-target-xqvmz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:27.380096 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:27.380058    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9bc22fa-fb2f-46ee-a049-614b16402835-kube-api-access-48wjr podName:d9bc22fa-fb2f-46ee-a049-614b16402835 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:27.880041876 +0000 UTC m=+2.048679226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-48wjr" (UniqueName: "kubernetes.io/projected/d9bc22fa-fb2f-46ee-a049-614b16402835-kube-api-access-48wjr") pod "network-check-target-xqvmz" (UID: "d9bc22fa-fb2f-46ee-a049-614b16402835") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:27.381729 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.381698    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6knt6\" (UniqueName: \"kubernetes.io/projected/0311940e-8fe1-4dba-9f40-418274c065cc-kube-api-access-6knt6\") pod \"node-resolver-g8zpg\" (UID: \"0311940e-8fe1-4dba-9f40-418274c065cc\") " pod="openshift-dns/node-resolver-g8zpg"
Aug 04 00:02:27.382207 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.382173    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxhx9\" (UniqueName: \"kubernetes.io/projected/9c6c3928-98eb-496e-bee1-e54cf1c8d7ec-kube-api-access-bxhx9\") pod \"tuned-9sv72\" (UID: \"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec\") " pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.382586 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.382565    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srsgc\" (UniqueName: \"kubernetes.io/projected/d0e3954b-476e-4ce8-a5e5-9364801153ed-kube-api-access-srsgc\") pod \"node-ca-zw2l8\" (UID: \"d0e3954b-476e-4ce8-a5e5-9364801153ed\") " pod="openshift-image-registry/node-ca-zw2l8"
Aug 04 00:02:27.382876 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.382856    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6kfl\" (UniqueName: \"kubernetes.io/projected/46d8005c-382d-442b-bdda-ab4af6df878f-kube-api-access-z6kfl\") pod \"network-metrics-daemon-wx48v\" (UID: \"46d8005c-382d-442b-bdda-ab4af6df878f\") " pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:27.382991 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.382972    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqg4w\" (UniqueName: \"kubernetes.io/projected/542a9bb2-fa17-4f40-affd-3024a7968ec3-kube-api-access-kqg4w\") pod \"multus-sk5gb\" (UID: \"542a9bb2-fa17-4f40-affd-3024a7968ec3\") " pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.383150 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.383136    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb9l6\" (UniqueName: \"kubernetes.io/projected/ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e-kube-api-access-lb9l6\") pod \"aws-ebs-csi-driver-node-dzq6m\" (UID: \"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m"
Aug 04 00:02:27.383186 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.383172    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6wwx\" (UniqueName: \"kubernetes.io/projected/4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a-kube-api-access-c6wwx\") pod \"multus-additional-cni-plugins-sxn7d\" (UID: \"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a\") " pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.481790 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.481736    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k84m6"
Aug 04 00:02:27.489745 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:27.489725    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c0d370f_ee60_44b6_a225_0311447ac802.slice/crio-adc9ccb07c5ab483c675dbb05f7a9711fa4a9ed6d88a483fdfad66e414b51b11 WatchSource:0}: Error finding container adc9ccb07c5ab483c675dbb05f7a9711fa4a9ed6d88a483fdfad66e414b51b11: Status 404 returned error can't find the container with id adc9ccb07c5ab483c675dbb05f7a9711fa4a9ed6d88a483fdfad66e414b51b11
Aug 04 00:02:27.494786 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.494768    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:27.501124 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:27.501099    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7e62961_9c80_467c_b7ea_0ddd6bcec813.slice/crio-e0afcb4e79d04b0e1165028d94a05bc2d159c293db9b2f533c577d7aefe2dd05 WatchSource:0}: Error finding container e0afcb4e79d04b0e1165028d94a05bc2d159c293db9b2f533c577d7aefe2dd05: Status 404 returned error can't find the container with id e0afcb4e79d04b0e1165028d94a05bc2d159c293db9b2f533c577d7aefe2dd05
Aug 04 00:02:27.506744 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.506727    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m"
Aug 04 00:02:27.511557 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.511542    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g8zpg"
Aug 04 00:02:27.513232 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:27.513183    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff55ba6b_8d19_4fc7_84f4_f6b8ae0f549e.slice/crio-ebe5b3cd9a9a87c2e6e2ad1ae32d652d001094b945a2ec16267675a38459f960 WatchSource:0}: Error finding container ebe5b3cd9a9a87c2e6e2ad1ae32d652d001094b945a2ec16267675a38459f960: Status 404 returned error can't find the container with id ebe5b3cd9a9a87c2e6e2ad1ae32d652d001094b945a2ec16267675a38459f960
Aug 04 00:02:27.520114 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:27.520097    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0311940e_8fe1_4dba_9f40_418274c065cc.slice/crio-ffabe2c0ad87d4304dbf05c28e783704e2c92a728ee73dcec997ad0c218ef1c6 WatchSource:0}: Error finding container ffabe2c0ad87d4304dbf05c28e783704e2c92a728ee73dcec997ad0c218ef1c6: Status 404 returned error can't find the container with id ffabe2c0ad87d4304dbf05c28e783704e2c92a728ee73dcec997ad0c218ef1c6
Aug 04 00:02:27.537951 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.537922    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sxn7d"
Aug 04 00:02:27.544113 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:27.544096    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ff6cd01_3ef7_4825_a025_5ecdfb00ba7a.slice/crio-1d83dd4c49930004c434e3e6c52de333f60edff54a391f38a6c67c9a5d3a23c5 WatchSource:0}: Error finding container 1d83dd4c49930004c434e3e6c52de333f60edff54a391f38a6c67c9a5d3a23c5: Status 404 returned error can't find the container with id 1d83dd4c49930004c434e3e6c52de333f60edff54a391f38a6c67c9a5d3a23c5
Aug 04 00:02:27.565553 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.565532    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4wgvp"
Aug 04 00:02:27.571439 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:27.571420    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f920924_9925_422d_b1d1_7b423471ffa2.slice/crio-80e59a64e3e1d811c65dd97dc0f43f691a7b2d54a9fc9b0e24b6531c7a41921c WatchSource:0}: Error finding container 80e59a64e3e1d811c65dd97dc0f43f691a7b2d54a9fc9b0e24b6531c7a41921c: Status 404 returned error can't find the container with id 80e59a64e3e1d811c65dd97dc0f43f691a7b2d54a9fc9b0e24b6531c7a41921c
Aug 04 00:02:27.572788 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.572768    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9sv72"
Aug 04 00:02:27.579399 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.579333    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zw2l8"
Aug 04 00:02:27.583331 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.583311    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sk5gb"
Aug 04 00:02:27.586332 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:27.586293    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0e3954b_476e_4ce8_a5e5_9364801153ed.slice/crio-e074169c05f77b5a70fc53aa77b64b82108648cad55b6493d8f23398ef7b4824 WatchSource:0}: Error finding container e074169c05f77b5a70fc53aa77b64b82108648cad55b6493d8f23398ef7b4824: Status 404 returned error can't find the container with id e074169c05f77b5a70fc53aa77b64b82108648cad55b6493d8f23398ef7b4824
Aug 04 00:02:27.591004 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:02:27.590984    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod542a9bb2_fa17_4f40_affd_3024a7968ec3.slice/crio-d1c62877bb5f5b0f583b0c8ad945e7245d3ca5f464719251f7a5db045126ec39 WatchSource:0}: Error finding container d1c62877bb5f5b0f583b0c8ad945e7245d3ca5f464719251f7a5db045126ec39: Status 404 returned error can't find the container with id d1c62877bb5f5b0f583b0c8ad945e7245d3ca5f464719251f7a5db045126ec39
Aug 04 00:02:27.618267 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.618250    2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 00:02:27.878475 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.878390    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d8005c-382d-442b-bdda-ab4af6df878f-metrics-certs\") pod \"network-metrics-daemon-wx48v\" (UID: \"46d8005c-382d-442b-bdda-ab4af6df878f\") " pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:27.878664 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.878489    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1c75c58e-ca1e-40b0-8993-9a91f8214235-original-pull-secret\") pod \"global-pull-secret-syncer-hw9ff\" (UID: \"1c75c58e-ca1e-40b0-8993-9a91f8214235\") " pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:27.878664 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:27.878562    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:27.878664 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:27.878629    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:27.878664 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:27.878658    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46d8005c-382d-442b-bdda-ab4af6df878f-metrics-certs podName:46d8005c-382d-442b-bdda-ab4af6df878f nodeName:}" failed. No retries permitted until 2026-08-04 00:02:28.878639376 +0000 UTC m=+3.047276743 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46d8005c-382d-442b-bdda-ab4af6df878f-metrics-certs") pod "network-metrics-daemon-wx48v" (UID: "46d8005c-382d-442b-bdda-ab4af6df878f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:27.878941 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:27.878677    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c75c58e-ca1e-40b0-8993-9a91f8214235-original-pull-secret podName:1c75c58e-ca1e-40b0-8993-9a91f8214235 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:28.878667453 +0000 UTC m=+3.047304800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1c75c58e-ca1e-40b0-8993-9a91f8214235-original-pull-secret") pod "global-pull-secret-syncer-hw9ff" (UID: "1c75c58e-ca1e-40b0-8993-9a91f8214235") : object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:27.979201 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:27.979168    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48wjr\" (UniqueName: \"kubernetes.io/projected/d9bc22fa-fb2f-46ee-a049-614b16402835-kube-api-access-48wjr\") pod \"network-check-target-xqvmz\" (UID: \"d9bc22fa-fb2f-46ee-a049-614b16402835\") " pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:27.979366 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:27.979346    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 00:02:27.979425 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:27.979367    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 00:02:27.979425 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:27.979380    2556 projected.go:196] Error preparing data for projected volume kube-api-access-48wjr for pod openshift-network-diagnostics/network-check-target-xqvmz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:27.979524 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:27.979431    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9bc22fa-fb2f-46ee-a049-614b16402835-kube-api-access-48wjr podName:d9bc22fa-fb2f-46ee-a049-614b16402835 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:28.97941214 +0000 UTC m=+3.148049501 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-48wjr" (UniqueName: "kubernetes.io/projected/d9bc22fa-fb2f-46ee-a049-614b16402835-kube-api-access-48wjr") pod "network-check-target-xqvmz" (UID: "d9bc22fa-fb2f-46ee-a049-614b16402835") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:28.176561 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:28.176488    2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 00:02:28.202684 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:28.202576    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-02 23:57:27 +0000 UTC" deadline="2028-03-10 18:49:16.307906211 +0000 UTC"
Aug 04 00:02:28.202684 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:28.202638    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14034h46m48.105273323s"
Aug 04 00:02:28.251023 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:28.250992    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 00:02:28.303422 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:28.301210    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:28.303422 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:28.301323    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:02:28.309091 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:28.309024    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g8zpg" event={"ID":"0311940e-8fe1-4dba-9f40-418274c065cc","Type":"ContainerStarted","Data":"ffabe2c0ad87d4304dbf05c28e783704e2c92a728ee73dcec997ad0c218ef1c6"}
Aug 04 00:02:28.312169 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:28.312079    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m" event={"ID":"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e","Type":"ContainerStarted","Data":"ebe5b3cd9a9a87c2e6e2ad1ae32d652d001094b945a2ec16267675a38459f960"}
Aug 04 00:02:28.321058 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:28.321034    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sk5gb" event={"ID":"542a9bb2-fa17-4f40-affd-3024a7968ec3","Type":"ContainerStarted","Data":"d1c62877bb5f5b0f583b0c8ad945e7245d3ca5f464719251f7a5db045126ec39"}
Aug 04 00:02:28.329619 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:28.329592    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zw2l8" event={"ID":"d0e3954b-476e-4ce8-a5e5-9364801153ed","Type":"ContainerStarted","Data":"e074169c05f77b5a70fc53aa77b64b82108648cad55b6493d8f23398ef7b4824"}
Aug 04 00:02:28.332593 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:28.332392    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4wgvp" event={"ID":"6f920924-9925-422d-b1d1-7b423471ffa2","Type":"ContainerStarted","Data":"80e59a64e3e1d811c65dd97dc0f43f691a7b2d54a9fc9b0e24b6531c7a41921c"}
Aug 04 00:02:28.335059 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:28.335016    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxn7d" event={"ID":"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a","Type":"ContainerStarted","Data":"1d83dd4c49930004c434e3e6c52de333f60edff54a391f38a6c67c9a5d3a23c5"}
Aug 04 00:02:28.341373 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:28.341346    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb" event={"ID":"c7e62961-9c80-467c-b7ea-0ddd6bcec813","Type":"ContainerStarted","Data":"e0afcb4e79d04b0e1165028d94a05bc2d159c293db9b2f533c577d7aefe2dd05"}
Aug 04 00:02:28.344919 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:28.344892    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k84m6" event={"ID":"4c0d370f-ee60-44b6-a225-0311447ac802","Type":"ContainerStarted","Data":"adc9ccb07c5ab483c675dbb05f7a9711fa4a9ed6d88a483fdfad66e414b51b11"}
Aug 04 00:02:28.354117 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:28.354092    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9sv72" event={"ID":"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec","Type":"ContainerStarted","Data":"c710e4d17eeb5f622551ff94686b3e21c6d1db2d3d4d74ec4cac7efd3c67f00c"}
Aug 04 00:02:28.887134 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:28.887094    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1c75c58e-ca1e-40b0-8993-9a91f8214235-original-pull-secret\") pod \"global-pull-secret-syncer-hw9ff\" (UID: \"1c75c58e-ca1e-40b0-8993-9a91f8214235\") " pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:28.887307 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:28.887150    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d8005c-382d-442b-bdda-ab4af6df878f-metrics-certs\") pod \"network-metrics-daemon-wx48v\" (UID: \"46d8005c-382d-442b-bdda-ab4af6df878f\") " pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:28.887379 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:28.887320    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:28.887433 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:28.887380    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46d8005c-382d-442b-bdda-ab4af6df878f-metrics-certs podName:46d8005c-382d-442b-bdda-ab4af6df878f nodeName:}" failed. No retries permitted until 2026-08-04 00:02:30.887362273 +0000 UTC m=+5.055999623 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46d8005c-382d-442b-bdda-ab4af6df878f-metrics-certs") pod "network-metrics-daemon-wx48v" (UID: "46d8005c-382d-442b-bdda-ab4af6df878f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:28.887807 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:28.887786    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:28.887911 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:28.887845    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c75c58e-ca1e-40b0-8993-9a91f8214235-original-pull-secret podName:1c75c58e-ca1e-40b0-8993-9a91f8214235 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:30.887829087 +0000 UTC m=+5.056466440 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1c75c58e-ca1e-40b0-8993-9a91f8214235-original-pull-secret") pod "global-pull-secret-syncer-hw9ff" (UID: "1c75c58e-ca1e-40b0-8993-9a91f8214235") : object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:28.987529 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:28.987492    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48wjr\" (UniqueName: \"kubernetes.io/projected/d9bc22fa-fb2f-46ee-a049-614b16402835-kube-api-access-48wjr\") pod \"network-check-target-xqvmz\" (UID: \"d9bc22fa-fb2f-46ee-a049-614b16402835\") " pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:28.987738 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:28.987706    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 00:02:28.987801 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:28.987747    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 00:02:28.987801 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:28.987760    2556 projected.go:196] Error preparing data for projected volume kube-api-access-48wjr for pod openshift-network-diagnostics/network-check-target-xqvmz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:28.987913 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:28.987816    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9bc22fa-fb2f-46ee-a049-614b16402835-kube-api-access-48wjr podName:d9bc22fa-fb2f-46ee-a049-614b16402835 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:30.987799415 +0000 UTC m=+5.156436775 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-48wjr" (UniqueName: "kubernetes.io/projected/d9bc22fa-fb2f-46ee-a049-614b16402835-kube-api-access-48wjr") pod "network-check-target-xqvmz" (UID: "d9bc22fa-fb2f-46ee-a049-614b16402835") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:29.203825 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:29.203736    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-02 23:57:27 +0000 UTC" deadline="2028-02-04 17:12:35.444394312 +0000 UTC"
Aug 04 00:02:29.203825 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:29.203774    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13193h10m6.24062476s"
Aug 04 00:02:29.301671 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:29.301608    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:29.301845 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:29.301747    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:02:29.302103 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:29.302083    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:29.302216 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:29.302197    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:02:30.286823 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:30.286793    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 00:02:30.302996 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:30.302551    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:30.302996 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:30.302667    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:02:30.908057 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:30.907949    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1c75c58e-ca1e-40b0-8993-9a91f8214235-original-pull-secret\") pod \"global-pull-secret-syncer-hw9ff\" (UID: \"1c75c58e-ca1e-40b0-8993-9a91f8214235\") " pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:30.908057 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:30.908002    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d8005c-382d-442b-bdda-ab4af6df878f-metrics-certs\") pod \"network-metrics-daemon-wx48v\" (UID: \"46d8005c-382d-442b-bdda-ab4af6df878f\") " pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:30.908294 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:30.908128    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:30.908294 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:30.908192    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46d8005c-382d-442b-bdda-ab4af6df878f-metrics-certs podName:46d8005c-382d-442b-bdda-ab4af6df878f nodeName:}" failed. No retries permitted until 2026-08-04 00:02:34.908171458 +0000 UTC m=+9.076808808 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46d8005c-382d-442b-bdda-ab4af6df878f-metrics-certs") pod "network-metrics-daemon-wx48v" (UID: "46d8005c-382d-442b-bdda-ab4af6df878f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:30.908590 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:30.908570    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:30.908683 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:30.908626    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c75c58e-ca1e-40b0-8993-9a91f8214235-original-pull-secret podName:1c75c58e-ca1e-40b0-8993-9a91f8214235 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:34.90861076 +0000 UTC m=+9.077248113 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1c75c58e-ca1e-40b0-8993-9a91f8214235-original-pull-secret") pod "global-pull-secret-syncer-hw9ff" (UID: "1c75c58e-ca1e-40b0-8993-9a91f8214235") : object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:31.008943 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:31.008908    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48wjr\" (UniqueName: \"kubernetes.io/projected/d9bc22fa-fb2f-46ee-a049-614b16402835-kube-api-access-48wjr\") pod \"network-check-target-xqvmz\" (UID: \"d9bc22fa-fb2f-46ee-a049-614b16402835\") " pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:31.009142 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:31.009096    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 00:02:31.009142 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:31.009119    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 00:02:31.009142 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:31.009133    2556 projected.go:196] Error preparing data for projected volume kube-api-access-48wjr for pod openshift-network-diagnostics/network-check-target-xqvmz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:31.009304 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:31.009198    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9bc22fa-fb2f-46ee-a049-614b16402835-kube-api-access-48wjr podName:d9bc22fa-fb2f-46ee-a049-614b16402835 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:35.009178237 +0000 UTC m=+9.177815609 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-48wjr" (UniqueName: "kubernetes.io/projected/d9bc22fa-fb2f-46ee-a049-614b16402835-kube-api-access-48wjr") pod "network-check-target-xqvmz" (UID: "d9bc22fa-fb2f-46ee-a049-614b16402835") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:31.301405 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:31.301374    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:31.301864 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:31.301510    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:02:31.301937 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:31.301883    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:31.301989 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:31.301971    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:02:32.305141 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:32.305076    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:32.305565 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:32.305188    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:02:33.301705 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:33.301672    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:33.301898 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:33.301810    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:02:33.302247 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:33.302215    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:33.302381 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:33.302313    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:02:34.305336 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:34.305308    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:34.305744 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:34.305427    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:02:34.945145 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:34.944458    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1c75c58e-ca1e-40b0-8993-9a91f8214235-original-pull-secret\") pod \"global-pull-secret-syncer-hw9ff\" (UID: \"1c75c58e-ca1e-40b0-8993-9a91f8214235\") " pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:34.945145 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:34.944511    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d8005c-382d-442b-bdda-ab4af6df878f-metrics-certs\") pod \"network-metrics-daemon-wx48v\" (UID: \"46d8005c-382d-442b-bdda-ab4af6df878f\") " pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:34.945145 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:34.944728    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:34.945145 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:34.944795    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46d8005c-382d-442b-bdda-ab4af6df878f-metrics-certs podName:46d8005c-382d-442b-bdda-ab4af6df878f nodeName:}" failed. No retries permitted until 2026-08-04 00:02:42.944776327 +0000 UTC m=+17.113413691 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46d8005c-382d-442b-bdda-ab4af6df878f-metrics-certs") pod "network-metrics-daemon-wx48v" (UID: "46d8005c-382d-442b-bdda-ab4af6df878f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:34.945145 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:34.944804    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:34.945145 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:34.944852    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c75c58e-ca1e-40b0-8993-9a91f8214235-original-pull-secret podName:1c75c58e-ca1e-40b0-8993-9a91f8214235 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:42.944839405 +0000 UTC m=+17.113476755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1c75c58e-ca1e-40b0-8993-9a91f8214235-original-pull-secret") pod "global-pull-secret-syncer-hw9ff" (UID: "1c75c58e-ca1e-40b0-8993-9a91f8214235") : object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:35.045365 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:35.045327    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48wjr\" (UniqueName: \"kubernetes.io/projected/d9bc22fa-fb2f-46ee-a049-614b16402835-kube-api-access-48wjr\") pod \"network-check-target-xqvmz\" (UID: \"d9bc22fa-fb2f-46ee-a049-614b16402835\") " pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:35.045524 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:35.045484    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 00:02:35.045524 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:35.045503    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 00:02:35.045524 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:35.045514    2556 projected.go:196] Error preparing data for projected volume kube-api-access-48wjr for pod openshift-network-diagnostics/network-check-target-xqvmz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:35.045689 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:35.045563    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9bc22fa-fb2f-46ee-a049-614b16402835-kube-api-access-48wjr podName:d9bc22fa-fb2f-46ee-a049-614b16402835 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:43.045550417 +0000 UTC m=+17.214187764 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-48wjr" (UniqueName: "kubernetes.io/projected/d9bc22fa-fb2f-46ee-a049-614b16402835-kube-api-access-48wjr") pod "network-check-target-xqvmz" (UID: "d9bc22fa-fb2f-46ee-a049-614b16402835") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:35.301988 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:35.301954    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:35.302143 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:35.302100    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:02:35.302470 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:35.302278    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:35.302470 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:35.302417    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:02:36.302929 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:36.302886    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:36.303306 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:36.303000    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:02:37.301190 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:37.301156    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:37.301190 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:37.301191    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:37.301423 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:37.301300    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:02:37.301482 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:37.301409    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:02:38.301427 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:38.301214    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:38.301883 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:38.301522    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:02:39.301798 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:39.301761    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:39.302258 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:39.301813    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:39.302258 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:39.301946    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:02:39.302258 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:39.302142    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:02:40.302017 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:40.301979    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:40.302450 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:40.302093    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:02:41.301279 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:41.301251    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:41.301460 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:41.301290    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:41.301460 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:41.301377    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:02:41.301581 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:41.301545    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:02:42.301788 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:42.301761    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:42.302160 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:42.301858    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:02:43.004621 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:43.004585    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1c75c58e-ca1e-40b0-8993-9a91f8214235-original-pull-secret\") pod \"global-pull-secret-syncer-hw9ff\" (UID: \"1c75c58e-ca1e-40b0-8993-9a91f8214235\") " pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:43.004621 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:43.004625    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d8005c-382d-442b-bdda-ab4af6df878f-metrics-certs\") pod \"network-metrics-daemon-wx48v\" (UID: \"46d8005c-382d-442b-bdda-ab4af6df878f\") " pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:43.004958 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:43.004751    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:43.004958 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:43.004787    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:43.004958 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:43.004813    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c75c58e-ca1e-40b0-8993-9a91f8214235-original-pull-secret podName:1c75c58e-ca1e-40b0-8993-9a91f8214235 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:59.004797553 +0000 UTC m=+33.173434903 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1c75c58e-ca1e-40b0-8993-9a91f8214235-original-pull-secret") pod "global-pull-secret-syncer-hw9ff" (UID: "1c75c58e-ca1e-40b0-8993-9a91f8214235") : object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:43.004958 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:43.004840    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46d8005c-382d-442b-bdda-ab4af6df878f-metrics-certs podName:46d8005c-382d-442b-bdda-ab4af6df878f nodeName:}" failed. No retries permitted until 2026-08-04 00:02:59.004822764 +0000 UTC m=+33.173460126 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46d8005c-382d-442b-bdda-ab4af6df878f-metrics-certs") pod "network-metrics-daemon-wx48v" (UID: "46d8005c-382d-442b-bdda-ab4af6df878f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:43.105854 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:43.105820    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48wjr\" (UniqueName: \"kubernetes.io/projected/d9bc22fa-fb2f-46ee-a049-614b16402835-kube-api-access-48wjr\") pod \"network-check-target-xqvmz\" (UID: \"d9bc22fa-fb2f-46ee-a049-614b16402835\") " pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:43.106020 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:43.105980    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 00:02:43.106020 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:43.106001    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 00:02:43.106020 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:43.106014    2556 projected.go:196] Error preparing data for projected volume kube-api-access-48wjr for pod openshift-network-diagnostics/network-check-target-xqvmz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:43.106153 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:43.106067    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9bc22fa-fb2f-46ee-a049-614b16402835-kube-api-access-48wjr podName:d9bc22fa-fb2f-46ee-a049-614b16402835 nodeName:}" failed. No retries permitted until 2026-08-04 00:02:59.106053957 +0000 UTC m=+33.274691308 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-48wjr" (UniqueName: "kubernetes.io/projected/d9bc22fa-fb2f-46ee-a049-614b16402835-kube-api-access-48wjr") pod "network-check-target-xqvmz" (UID: "d9bc22fa-fb2f-46ee-a049-614b16402835") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:43.301203 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:43.301127    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:43.301358 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:43.301127    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:43.301358 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:43.301253    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:02:43.301358 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:43.301312    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:02:44.301435 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:44.301398    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:44.301889 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:44.301528    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:02:45.301483 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:45.301442    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:45.301483 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:45.301471    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:45.302010 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:45.301586    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:02:45.302010 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:45.301704    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:02:46.302147 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:46.302063    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:46.302404 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:46.302167    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:02:47.301870 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.301685    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:47.302050 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.301742    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:47.302050 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:47.301940    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:02:47.302050 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:47.302036    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:02:47.393176 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.393147    2556 generic.go:356] "Generic (PLEG): container finished" podID="904e03550f1156d10a235812f1eccc8d" containerID="877b3177b3ada5d9848ad265c6cd6275cad0585ff0406be78b271cc2ed4856fe" exitCode=0
Aug 04 00:02:47.393884 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.393220    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-2.ec2.internal" event={"ID":"904e03550f1156d10a235812f1eccc8d","Type":"ContainerDied","Data":"877b3177b3ada5d9848ad265c6cd6275cad0585ff0406be78b271cc2ed4856fe"}
Aug 04 00:02:47.394663 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.394641    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9sv72" event={"ID":"9c6c3928-98eb-496e-bee1-e54cf1c8d7ec","Type":"ContainerStarted","Data":"4eff54ebdab36c432c5327f3fc53d186c87ca0f176753e2e04860bf906e60af6"}
Aug 04 00:02:47.396111 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.396089    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g8zpg" event={"ID":"0311940e-8fe1-4dba-9f40-418274c065cc","Type":"ContainerStarted","Data":"fb6bd1385ce1089534aa8b19f6b13c57279ce47457d7b170417bda3f3d4b851b"}
Aug 04 00:02:47.397439 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.397422    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m" event={"ID":"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e","Type":"ContainerStarted","Data":"dcc25da908f5a975d65aeeaf9f21d9f75dbb20daeabebd1c5d0c42ab7376a600"}
Aug 04 00:02:47.398883 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.398861    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-2.ec2.internal" event={"ID":"60020f9b08eeb842b087b428d24d6e5c","Type":"ContainerStarted","Data":"332076ab93057b5c2d562898c15db1d4cb9a02a423b54bf60b244045065be8f0"}
Aug 04 00:02:47.400340 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.400320    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sk5gb" event={"ID":"542a9bb2-fa17-4f40-affd-3024a7968ec3","Type":"ContainerStarted","Data":"6d859c249b983eb0fb484368b8dfd42468f7333c1e3d4f5e2b78577d2d4d3213"}
Aug 04 00:02:47.401652 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.401624    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zw2l8" event={"ID":"d0e3954b-476e-4ce8-a5e5-9364801153ed","Type":"ContainerStarted","Data":"b4a39269623c79caa0c0ca2b26f173adc85ffd1fc546527f9c57aa2350ac5b38"}
Aug 04 00:02:47.403044 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.403024    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4wgvp" event={"ID":"6f920924-9925-422d-b1d1-7b423471ffa2","Type":"ContainerStarted","Data":"87532e8fda69ad562084cd2186baa88e9d626e77b9939dc3d701d30fd5916907"}
Aug 04 00:02:47.404373 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.404353    2556 generic.go:356] "Generic (PLEG): container finished" podID="4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a" containerID="3627135120bfb63412afc8b5d71769c2a52e017b247de9bb8763486791cfc416" exitCode=0
Aug 04 00:02:47.404464 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.404416    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxn7d" event={"ID":"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a","Type":"ContainerDied","Data":"3627135120bfb63412afc8b5d71769c2a52e017b247de9bb8763486791cfc416"}
Aug 04 00:02:47.407271 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.407095    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:02:47.409262 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.409048    2556 generic.go:356] "Generic (PLEG): container finished" podID="c7e62961-9c80-467c-b7ea-0ddd6bcec813" containerID="94c580743a48606e91eb241ec66922f01f55e6c734186c112c1e6b45ec6255d6" exitCode=1
Aug 04 00:02:47.409262 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.409120    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb" event={"ID":"c7e62961-9c80-467c-b7ea-0ddd6bcec813","Type":"ContainerStarted","Data":"201bee8f5c6f6ce3a408d01963472bd04e3c2a51e39bea409f27d1aa7989bac7"}
Aug 04 00:02:47.409398 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.409322    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb" event={"ID":"c7e62961-9c80-467c-b7ea-0ddd6bcec813","Type":"ContainerStarted","Data":"d80047e911438fe34de6a903a6dee70f432a2e388ad9effe8ed0cf64b42a6066"}
Aug 04 00:02:47.409398 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.409368    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb" event={"ID":"c7e62961-9c80-467c-b7ea-0ddd6bcec813","Type":"ContainerStarted","Data":"ec8fc9658dc9f85f160a928fed239cdeb940002d6dd07797f6e7218022cb279e"}
Aug 04 00:02:47.409487 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.409411    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb" event={"ID":"c7e62961-9c80-467c-b7ea-0ddd6bcec813","Type":"ContainerStarted","Data":"37048df9154a17f76f6f967b6e53f03e9dc7f5450d2d8eeeed66edec24e2848b"}
Aug 04 00:02:47.409487 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.409453    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb" event={"ID":"c7e62961-9c80-467c-b7ea-0ddd6bcec813","Type":"ContainerDied","Data":"94c580743a48606e91eb241ec66922f01f55e6c734186c112c1e6b45ec6255d6"}
Aug 04 00:02:47.409556 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.409494    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb" event={"ID":"c7e62961-9c80-467c-b7ea-0ddd6bcec813","Type":"ContainerStarted","Data":"5abfcde9e0076183719b52e9b889bd0de2def6edd9fbc7c49d9cb677eff641a8"}
Aug 04 00:02:47.427126 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.427064    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9sv72" podStartSLOduration=2.684610726 podStartE2EDuration="21.427048035s" totalImagesPullingTime="18.742437309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:47.42634192 +0000 UTC m=+21.594979289" watchObservedRunningTime="2026-08-04 00:02:47.427048035 +0000 UTC m=+21.595685407"
Aug 04 00:02:47.443291 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.443256    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zw2l8" podStartSLOduration=2.756218528 podStartE2EDuration="21.443244923s" totalImagesPullingTime="18.687026395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:47.443081438 +0000 UTC m=+21.611718810" watchObservedRunningTime="2026-08-04 00:02:47.443244923 +0000 UTC m=+21.611882292"
Aug 04 00:02:47.458098 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.458061    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sk5gb" podStartSLOduration=2.387488147 podStartE2EDuration="21.458050536s" totalImagesPullingTime="19.070562389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:47.457850741 +0000 UTC m=+21.626488109" watchObservedRunningTime="2026-08-04 00:02:47.458050536 +0000 UTC m=+21.626687917"
Aug 04 00:02:47.475619 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.475557    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-2.ec2.internal" podStartSLOduration=20.47554619 podStartE2EDuration="20.47554619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:02:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:47.475487905 +0000 UTC m=+21.644125274" watchObservedRunningTime="2026-08-04 00:02:47.47554619 +0000 UTC m=+21.644183560"
Aug 04 00:02:47.494047 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.494011    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-g8zpg" podStartSLOduration=2.691652755 podStartE2EDuration="21.493998913s" totalImagesPullingTime="18.802346158s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:47.493487275 +0000 UTC m=+21.662124646" watchObservedRunningTime="2026-08-04 00:02:47.493998913 +0000 UTC m=+21.662636282"
Aug 04 00:02:47.546075 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.546024    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4wgvp" podStartSLOduration=2.828937113 podStartE2EDuration="21.546005216s" totalImagesPullingTime="18.717068103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:47.544963134 +0000 UTC m=+21.713600502" watchObservedRunningTime="2026-08-04 00:02:47.546005216 +0000 UTC m=+21.714642586"
Aug 04 00:02:47.949903 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:47.949880    2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 04 00:02:48.242603 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:48.242444    2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-04T00:02:47.949898165Z","UUID":"282e6621-dad1-4042-b716-c1f580c06448","Handler":null,"Name":"","Endpoint":""}
Aug 04 00:02:48.244176 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:48.244150    2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 04 00:02:48.244272 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:48.244194    2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 04 00:02:48.301315 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:48.301283    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:48.301510 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:48.301388    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:02:48.413127 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:48.413090    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k84m6" event={"ID":"4c0d370f-ee60-44b6-a225-0311447ac802","Type":"ContainerStarted","Data":"ebae2fff3a34223ea9ae8861a24bd28702b4b755a218add3faa7b8f120f1b08b"}
Aug 04 00:02:48.415391 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:48.415356    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-2.ec2.internal" event={"ID":"904e03550f1156d10a235812f1eccc8d","Type":"ContainerStarted","Data":"a7841661ff597b8b165716567c31e130188395c289cb487ac3a08ec95e284c68"}
Aug 04 00:02:48.417188 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:48.417161    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m" event={"ID":"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e","Type":"ContainerStarted","Data":"1f58f500ecd28895f41b3c05ef33f0772aef46d96dcb16539c5c5323c80a5264"}
Aug 04 00:02:48.428326 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:48.428281    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-k84m6" podStartSLOduration=3.614179398 podStartE2EDuration="22.428264892s" totalImagesPullingTime="18.814085494s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:48.428245145 +0000 UTC m=+22.596882516" watchObservedRunningTime="2026-08-04 00:02:48.428264892 +0000 UTC m=+22.596902261"
Aug 04 00:02:48.443064 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:48.443026    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-2.ec2.internal" podStartSLOduration=21.443017216 podStartE2EDuration="21.443017216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:02:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:48.442531442 +0000 UTC m=+22.611168814" watchObservedRunningTime="2026-08-04 00:02:48.443017216 +0000 UTC m=+22.611654585"
Aug 04 00:02:49.300980 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:49.300941    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:49.301180 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:49.301077    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:02:49.301180 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:49.301133    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:49.301310 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:49.301239    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:02:49.422045 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:49.422008    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m" event={"ID":"ff55ba6b-8d19-4fc7-84f4-f6b8ae0f549e","Type":"ContainerStarted","Data":"f37d1bd7fca9911abecfed9a3b98a3eae4e0e44e290aad35cbd11ce9763aeec7"}
Aug 04 00:02:49.426046 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:49.425796    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:02:49.426216 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:49.426191    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb" event={"ID":"c7e62961-9c80-467c-b7ea-0ddd6bcec813","Type":"ContainerStarted","Data":"7e595f291af6924aad6d3499979aae098adef2253739a525c98386194768004d"}
Aug 04 00:02:49.437952 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:49.437909    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzq6m" podStartSLOduration=2.796945628 podStartE2EDuration="23.437896278s" totalImagesPullingTime="20.64095065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:02:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:49.437500726 +0000 UTC m=+23.606138095" watchObservedRunningTime="2026-08-04 00:02:49.437896278 +0000 UTC m=+23.606533646"
Aug 04 00:02:50.301177 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:50.301147    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:50.301334 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:50.301262    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:02:51.301502 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:51.301471    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:51.302008 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:51.301515    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:51.302008 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:51.301612    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:02:51.302008 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:51.301753    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:02:51.619977 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:51.619941    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4wgvp"
Aug 04 00:02:51.620553 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:51.620531    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4wgvp"
Aug 04 00:02:52.301240 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:52.301085    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:52.301386 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:52.301319    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:02:52.434740 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:52.434696    2556 generic.go:356] "Generic (PLEG): container finished" podID="4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a" containerID="14cef0b7d875f319b1f2d4b7fe5ab85b4aefa7b7b11c419ecd1c80ee02b55b2e" exitCode=0
Aug 04 00:02:52.435552 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:52.434783    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxn7d" event={"ID":"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a","Type":"ContainerDied","Data":"14cef0b7d875f319b1f2d4b7fe5ab85b4aefa7b7b11c419ecd1c80ee02b55b2e"}
Aug 04 00:02:52.437969 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:52.437952    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:02:52.438356 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:52.438335    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb" event={"ID":"c7e62961-9c80-467c-b7ea-0ddd6bcec813","Type":"ContainerStarted","Data":"966f0757be925299cd6e1235744495efa12b17135b7e8e030f8fba8feba36a25"}
Aug 04 00:02:52.438490 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:52.438475    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4wgvp"
Aug 04 00:02:52.439804 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:52.439743    2556 scope.go:117] "RemoveContainer" containerID="94c580743a48606e91eb241ec66922f01f55e6c734186c112c1e6b45ec6255d6"
Aug 04 00:02:52.442851 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:52.442830    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4wgvp"
Aug 04 00:02:53.302123 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:53.301920    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:53.302244 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:53.301949    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:53.302244 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:53.302181    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:02:53.302244 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:53.302228    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:02:53.442852 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:53.442820    2556 generic.go:356] "Generic (PLEG): container finished" podID="4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a" containerID="3372bbc077ff9852f1034f42dcb2560c65e09186c8d819e0faa1de5f1e7bad24" exitCode=0
Aug 04 00:02:53.443254 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:53.442910    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxn7d" event={"ID":"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a","Type":"ContainerDied","Data":"3372bbc077ff9852f1034f42dcb2560c65e09186c8d819e0faa1de5f1e7bad24"}
Aug 04 00:02:53.446687 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:53.446668    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:02:53.447158 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:53.447135    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb" event={"ID":"c7e62961-9c80-467c-b7ea-0ddd6bcec813","Type":"ContainerStarted","Data":"79e629ba902ab3786d250bb92d8a4f358a65e7337b2ce5f9016988182ab32376"}
Aug 04 00:02:53.447488 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:53.447336    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:53.447488 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:53.447405    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:53.447488 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:53.447446    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:53.462379 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:53.462342    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:53.462518 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:53.462504    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:02:53.490723 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:53.490658    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb" podStartSLOduration=8.64381955 podStartE2EDuration="27.490639651s" totalImagesPullingTime="18.846820101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:02:53.490199127 +0000 UTC m=+27.658836497" watchObservedRunningTime="2026-08-04 00:02:53.490639651 +0000 UTC m=+27.659277022"
Aug 04 00:02:53.827397 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:53.827336    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wx48v"]
Aug 04 00:02:53.827649 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:53.827510    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:53.827649 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:53.827629    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:02:53.828120 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:53.828093    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xqvmz"]
Aug 04 00:02:53.828234 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:53.828189    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:53.828327 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:53.828277    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:02:53.838934 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:53.838584    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hw9ff"]
Aug 04 00:02:53.838934 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:53.838686    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:53.838934 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:53.838781    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:02:54.451431 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:54.451355    2556 generic.go:356] "Generic (PLEG): container finished" podID="4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a" containerID="b0344f069e939ceb67aa2439eb730d497128434ae00f49b5472a1332a1515c7b" exitCode=0
Aug 04 00:02:54.451789 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:54.451433    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxn7d" event={"ID":"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a","Type":"ContainerDied","Data":"b0344f069e939ceb67aa2439eb730d497128434ae00f49b5472a1332a1515c7b"}
Aug 04 00:02:55.302099 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:55.302040    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:55.302099 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:55.302069    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:55.302099 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:55.302070    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:55.302377 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:55.302189    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:02:55.302377 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:55.302253    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:02:55.302377 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:55.302326    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:02:56.732933 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:56.732904    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g8zpg_0311940e-8fe1-4dba-9f40-418274c065cc/dns-node-resolver/0.log"
Aug 04 00:02:57.301400 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:57.301370    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:57.301548 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:57.301406    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:57.301548 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:57.301413    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:57.301548 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:57.301503    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:02:57.301680 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:57.301638    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:02:57.301760 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:57.301737    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:02:57.903300 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:57.903269    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zw2l8_d0e3954b-476e-4ce8-a5e5-9364801153ed/node-ca/0.log"
Aug 04 00:02:59.029738 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:59.029551    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1c75c58e-ca1e-40b0-8993-9a91f8214235-original-pull-secret\") pod \"global-pull-secret-syncer-hw9ff\" (UID: \"1c75c58e-ca1e-40b0-8993-9a91f8214235\") " pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:59.029738 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:59.029690    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:59.030211 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:59.029782    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c75c58e-ca1e-40b0-8993-9a91f8214235-original-pull-secret podName:1c75c58e-ca1e-40b0-8993-9a91f8214235 nodeName:}" failed. No retries permitted until 2026-08-04 00:03:31.029765493 +0000 UTC m=+65.198402840 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1c75c58e-ca1e-40b0-8993-9a91f8214235-original-pull-secret") pod "global-pull-secret-syncer-hw9ff" (UID: "1c75c58e-ca1e-40b0-8993-9a91f8214235") : object "kube-system"/"original-pull-secret" not registered
Aug 04 00:02:59.030211 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:59.029790    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:59.030211 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:59.029731    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d8005c-382d-442b-bdda-ab4af6df878f-metrics-certs\") pod \"network-metrics-daemon-wx48v\" (UID: \"46d8005c-382d-442b-bdda-ab4af6df878f\") " pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:59.030211 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:59.029830    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46d8005c-382d-442b-bdda-ab4af6df878f-metrics-certs podName:46d8005c-382d-442b-bdda-ab4af6df878f nodeName:}" failed. No retries permitted until 2026-08-04 00:03:31.029813728 +0000 UTC m=+65.198451076 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46d8005c-382d-442b-bdda-ab4af6df878f-metrics-certs") pod "network-metrics-daemon-wx48v" (UID: "46d8005c-382d-442b-bdda-ab4af6df878f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 00:02:59.130898 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:59.130832    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48wjr\" (UniqueName: \"kubernetes.io/projected/d9bc22fa-fb2f-46ee-a049-614b16402835-kube-api-access-48wjr\") pod \"network-check-target-xqvmz\" (UID: \"d9bc22fa-fb2f-46ee-a049-614b16402835\") " pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:59.131000 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:59.130952    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 00:02:59.131000 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:59.130966    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 00:02:59.131000 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:59.130975    2556 projected.go:196] Error preparing data for projected volume kube-api-access-48wjr for pod openshift-network-diagnostics/network-check-target-xqvmz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:59.131092 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:59.131025    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9bc22fa-fb2f-46ee-a049-614b16402835-kube-api-access-48wjr podName:d9bc22fa-fb2f-46ee-a049-614b16402835 nodeName:}" failed. No retries permitted until 2026-08-04 00:03:31.131011031 +0000 UTC m=+65.299648381 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-48wjr" (UniqueName: "kubernetes.io/projected/d9bc22fa-fb2f-46ee-a049-614b16402835-kube-api-access-48wjr") pod "network-check-target-xqvmz" (UID: "d9bc22fa-fb2f-46ee-a049-614b16402835") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 00:02:59.301583 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:59.301558    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:02:59.301737 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:59.301643    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:02:59.301737 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:59.301653    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:02:59.301737 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:59.301647    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:02:59.301845 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:59.301741    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:02:59.301845 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:02:59.301812    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:02:59.464123 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:59.464047    2556 generic.go:356] "Generic (PLEG): container finished" podID="4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a" containerID="c1e938cc2c76013dd41fcd336023b32700b2aba92bb997ede7c4eedf5fb897bc" exitCode=0
Aug 04 00:02:59.464123 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:02:59.464084    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxn7d" event={"ID":"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a","Type":"ContainerDied","Data":"c1e938cc2c76013dd41fcd336023b32700b2aba92bb997ede7c4eedf5fb897bc"}
Aug 04 00:03:00.468554 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:00.468522    2556 generic.go:356] "Generic (PLEG): container finished" podID="4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a" containerID="1e6504db3288201f03f19b365144a4f33c04ca3464e362ad9831ed9f21c2c4a5" exitCode=0
Aug 04 00:03:00.469000 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:00.468577    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxn7d" event={"ID":"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a","Type":"ContainerDied","Data":"1e6504db3288201f03f19b365144a4f33c04ca3464e362ad9831ed9f21c2c4a5"}
Aug 04 00:03:01.301254 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:01.301222    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:03:01.301426 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:01.301320    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:03:01.301426 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:01.301330    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:03:01.301426 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:01.301343    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:03:01.301426 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:01.301397    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:03:01.301603 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:01.301488    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:03:01.473464 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:01.473431    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxn7d" event={"ID":"4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a","Type":"ContainerStarted","Data":"894a6e2af78f9dcc7caf5e9ca2103c4b4802f9a86225d3c9ed74e823bcfa8133"}
Aug 04 00:03:01.497575 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:01.497534    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sxn7d" podStartSLOduration=6.760535148 podStartE2EDuration="35.497519573s" totalImagesPullingTime="28.736984425s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:02:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:01.497040467 +0000 UTC m=+35.665677835" watchObservedRunningTime="2026-08-04 00:03:01.497519573 +0000 UTC m=+35.666156942"
Aug 04 00:03:03.301613 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:03.301585    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:03:03.301613 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:03.301598    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:03:03.302086 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:03.301674    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:03:03.302086 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:03.301732    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:03:03.302086 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:03.301795    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:03:03.302086 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:03.301903    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:03:05.301187 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:05.301160    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:03:05.301543 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:05.301200    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:03:05.301543 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:05.301254    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:03:05.301543 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:05.301265    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:03:05.301543 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:05.301328    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:03:05.301543 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:05.301397    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:03:07.301075 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:07.301042    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:03:07.301430 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:07.301133    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:03:07.301430 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:07.301219    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:03:07.301430 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:07.301139    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:03:07.301430 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:07.301141    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:03:07.301430 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:07.301346    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:03:09.301840 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:09.301809    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:03:09.302215 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:09.301894    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:03:09.302215 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:09.301909    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:03:09.302215 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:09.301953    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:03:09.302215 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:09.301983    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:03:09.302215 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:09.302035    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:03:11.301478 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:11.301442    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:03:11.301839 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:11.301538    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:03:11.301839 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:11.301541    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:03:11.301839 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:11.301566    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:03:11.301839 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:11.301644    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:03:11.301839 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:11.301695    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:03:13.301896 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:13.301862    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:03:13.301896 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:13.301894    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:03:13.302412 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:13.301972    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqvmz" podUID="d9bc22fa-fb2f-46ee-a049-614b16402835"
Aug 04 00:03:13.302412 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:13.302035    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:03:13.302412 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:13.302147    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9ff" podUID="1c75c58e-ca1e-40b0-8993-9a91f8214235"
Aug 04 00:03:13.302412 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:13.302247    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx48v" podUID="46d8005c-382d-442b-bdda-ab4af6df878f"
Aug 04 00:03:15.155155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.155134    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-2.ec2.internal" event="NodeReady"
Aug 04 00:03:15.155440 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.155234    2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 04 00:03:15.211387 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.211363    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cjtcl"]
Aug 04 00:03:15.240020 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.239996    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-p75vz"]
Aug 04 00:03:15.240149 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.240120    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cjtcl"
Aug 04 00:03:15.242927 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.242900    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qvwq5\""
Aug 04 00:03:15.242927 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.242915    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 04 00:03:15.242927 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.242902    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 04 00:03:15.243136 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.242932    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 04 00:03:15.243268 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.243252    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 04 00:03:15.255962 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.255944    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cjtcl"]
Aug 04 00:03:15.256066 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.255979    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p75vz"]
Aug 04 00:03:15.256066 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.256046    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p75vz"
Aug 04 00:03:15.258452 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.258435    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 04 00:03:15.258545 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.258473    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9x2gl\""
Aug 04 00:03:15.258545 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.258490    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 04 00:03:15.301342 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.301318    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:03:15.301451 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.301416    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:03:15.301451 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.301440    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:03:15.303858 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.303838    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 00:03:15.303952 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.303842    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l74qs\""
Aug 04 00:03:15.304120 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.304107    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j4cq2\""
Aug 04 00:03:15.304239 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.304216    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 00:03:15.304537 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.304522    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 00:03:15.304920 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.304900    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 00:03:15.308456 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.308438    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-c26k6"]
Aug 04 00:03:15.326084 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.326059    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c26k6"
Aug 04 00:03:15.326084 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.326062    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c26k6"]
Aug 04 00:03:15.328899 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.328884    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 04 00:03:15.328992 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.328886    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-74zks\""
Aug 04 00:03:15.329115 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.329093    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 04 00:03:15.329216 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.329127    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 04 00:03:15.350935 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.350911    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e100a5f8-1a98-4c96-8dd5-0c490c60e06c-data-volume\") pod \"insights-runtime-extractor-cjtcl\" (UID: \"e100a5f8-1a98-4c96-8dd5-0c490c60e06c\") " pod="openshift-insights/insights-runtime-extractor-cjtcl"
Aug 04 00:03:15.351043 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.350942    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e100a5f8-1a98-4c96-8dd5-0c490c60e06c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjtcl\" (UID: \"e100a5f8-1a98-4c96-8dd5-0c490c60e06c\") " pod="openshift-insights/insights-runtime-extractor-cjtcl"
Aug 04 00:03:15.351043 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.351002    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e100a5f8-1a98-4c96-8dd5-0c490c60e06c-crio-socket\") pod \"insights-runtime-extractor-cjtcl\" (UID: \"e100a5f8-1a98-4c96-8dd5-0c490c60e06c\") " pod="openshift-insights/insights-runtime-extractor-cjtcl"
Aug 04 00:03:15.351157 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.351088    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e100a5f8-1a98-4c96-8dd5-0c490c60e06c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjtcl\" (UID: \"e100a5f8-1a98-4c96-8dd5-0c490c60e06c\") " pod="openshift-insights/insights-runtime-extractor-cjtcl"
Aug 04 00:03:15.351157 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.351120    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhtb9\" (UniqueName: \"kubernetes.io/projected/e100a5f8-1a98-4c96-8dd5-0c490c60e06c-kube-api-access-hhtb9\") pod \"insights-runtime-extractor-cjtcl\" (UID: \"e100a5f8-1a98-4c96-8dd5-0c490c60e06c\") " pod="openshift-insights/insights-runtime-extractor-cjtcl"
Aug 04 00:03:15.451812 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.451732    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e100a5f8-1a98-4c96-8dd5-0c490c60e06c-crio-socket\") pod \"insights-runtime-extractor-cjtcl\" (UID: \"e100a5f8-1a98-4c96-8dd5-0c490c60e06c\") " pod="openshift-insights/insights-runtime-extractor-cjtcl"
Aug 04 00:03:15.451812 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.451772    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t2bt\" (UniqueName: \"kubernetes.io/projected/05049a1e-914e-4f3a-977d-b26019f4cab7-kube-api-access-6t2bt\") pod \"dns-default-p75vz\" (UID: \"05049a1e-914e-4f3a-977d-b26019f4cab7\") " pod="openshift-dns/dns-default-p75vz"
Aug 04 00:03:15.451812 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.451792    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05049a1e-914e-4f3a-977d-b26019f4cab7-tmp-dir\") pod \"dns-default-p75vz\" (UID: \"05049a1e-914e-4f3a-977d-b26019f4cab7\") " pod="openshift-dns/dns-default-p75vz"
Aug 04 00:03:15.452013 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.451825    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e100a5f8-1a98-4c96-8dd5-0c490c60e06c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjtcl\" (UID: \"e100a5f8-1a98-4c96-8dd5-0c490c60e06c\") " pod="openshift-insights/insights-runtime-extractor-cjtcl"
Aug 04 00:03:15.452013 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.451843    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab18aa19-3c52-4b0d-81ca-b492f1c1a2d3-cert\") pod \"ingress-canary-c26k6\" (UID: \"ab18aa19-3c52-4b0d-81ca-b492f1c1a2d3\") " pod="openshift-ingress-canary/ingress-canary-c26k6"
Aug 04 00:03:15.452013 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.451884    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhtb9\" (UniqueName: \"kubernetes.io/projected/e100a5f8-1a98-4c96-8dd5-0c490c60e06c-kube-api-access-hhtb9\") pod \"insights-runtime-extractor-cjtcl\" (UID: \"e100a5f8-1a98-4c96-8dd5-0c490c60e06c\") " pod="openshift-insights/insights-runtime-extractor-cjtcl"
Aug 04 00:03:15.452013 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.451888    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e100a5f8-1a98-4c96-8dd5-0c490c60e06c-crio-socket\") pod \"insights-runtime-extractor-cjtcl\" (UID: \"e100a5f8-1a98-4c96-8dd5-0c490c60e06c\") " pod="openshift-insights/insights-runtime-extractor-cjtcl"
Aug 04 00:03:15.452013 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.451954    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e100a5f8-1a98-4c96-8dd5-0c490c60e06c-data-volume\") pod \"insights-runtime-extractor-cjtcl\" (UID: \"e100a5f8-1a98-4c96-8dd5-0c490c60e06c\") " pod="openshift-insights/insights-runtime-extractor-cjtcl"
Aug 04 00:03:15.452013 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.451971    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e100a5f8-1a98-4c96-8dd5-0c490c60e06c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjtcl\" (UID: \"e100a5f8-1a98-4c96-8dd5-0c490c60e06c\") " pod="openshift-insights/insights-runtime-extractor-cjtcl"
Aug 04 00:03:15.452013 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.451992    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05049a1e-914e-4f3a-977d-b26019f4cab7-metrics-tls\") pod \"dns-default-p75vz\" (UID: \"05049a1e-914e-4f3a-977d-b26019f4cab7\") " pod="openshift-dns/dns-default-p75vz"
Aug 04 00:03:15.452320 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.452019    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05049a1e-914e-4f3a-977d-b26019f4cab7-config-volume\") pod \"dns-default-p75vz\" (UID: \"05049a1e-914e-4f3a-977d-b26019f4cab7\") " pod="openshift-dns/dns-default-p75vz"
Aug 04 00:03:15.452320 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.452044    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nh55\" (UniqueName: \"kubernetes.io/projected/ab18aa19-3c52-4b0d-81ca-b492f1c1a2d3-kube-api-access-9nh55\") pod \"ingress-canary-c26k6\" (UID: \"ab18aa19-3c52-4b0d-81ca-b492f1c1a2d3\") " pod="openshift-ingress-canary/ingress-canary-c26k6"
Aug 04 00:03:15.452320 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.452313    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e100a5f8-1a98-4c96-8dd5-0c490c60e06c-data-volume\") pod \"insights-runtime-extractor-cjtcl\" (UID: \"e100a5f8-1a98-4c96-8dd5-0c490c60e06c\") " pod="openshift-insights/insights-runtime-extractor-cjtcl"
Aug 04 00:03:15.452521 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.452503    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e100a5f8-1a98-4c96-8dd5-0c490c60e06c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjtcl\" (UID: \"e100a5f8-1a98-4c96-8dd5-0c490c60e06c\") " pod="openshift-insights/insights-runtime-extractor-cjtcl"
Aug 04 00:03:15.455783 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.455767    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e100a5f8-1a98-4c96-8dd5-0c490c60e06c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjtcl\" (UID: \"e100a5f8-1a98-4c96-8dd5-0c490c60e06c\") " pod="openshift-insights/insights-runtime-extractor-cjtcl"
Aug 04 00:03:15.459374 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.459354    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhtb9\" (UniqueName: \"kubernetes.io/projected/e100a5f8-1a98-4c96-8dd5-0c490c60e06c-kube-api-access-hhtb9\") pod \"insights-runtime-extractor-cjtcl\" (UID: \"e100a5f8-1a98-4c96-8dd5-0c490c60e06c\") " pod="openshift-insights/insights-runtime-extractor-cjtcl"
Aug 04 00:03:15.549144 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.549118    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cjtcl"
Aug 04 00:03:15.553370 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.553352    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05049a1e-914e-4f3a-977d-b26019f4cab7-metrics-tls\") pod \"dns-default-p75vz\" (UID: \"05049a1e-914e-4f3a-977d-b26019f4cab7\") " pod="openshift-dns/dns-default-p75vz"
Aug 04 00:03:15.553425 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.553380    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05049a1e-914e-4f3a-977d-b26019f4cab7-config-volume\") pod \"dns-default-p75vz\" (UID: \"05049a1e-914e-4f3a-977d-b26019f4cab7\") " pod="openshift-dns/dns-default-p75vz"
Aug 04 00:03:15.553425 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.553400    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nh55\" (UniqueName: \"kubernetes.io/projected/ab18aa19-3c52-4b0d-81ca-b492f1c1a2d3-kube-api-access-9nh55\") pod \"ingress-canary-c26k6\" (UID: \"ab18aa19-3c52-4b0d-81ca-b492f1c1a2d3\") " pod="openshift-ingress-canary/ingress-canary-c26k6"
Aug 04 00:03:15.553488 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.553462    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t2bt\" (UniqueName: \"kubernetes.io/projected/05049a1e-914e-4f3a-977d-b26019f4cab7-kube-api-access-6t2bt\") pod \"dns-default-p75vz\" (UID: \"05049a1e-914e-4f3a-977d-b26019f4cab7\") " pod="openshift-dns/dns-default-p75vz"
Aug 04 00:03:15.553520 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.553487    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05049a1e-914e-4f3a-977d-b26019f4cab7-tmp-dir\") pod \"dns-default-p75vz\" (UID: \"05049a1e-914e-4f3a-977d-b26019f4cab7\") " pod="openshift-dns/dns-default-p75vz"
Aug 04 00:03:15.553678 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.553665    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab18aa19-3c52-4b0d-81ca-b492f1c1a2d3-cert\") pod \"ingress-canary-c26k6\" (UID: \"ab18aa19-3c52-4b0d-81ca-b492f1c1a2d3\") " pod="openshift-ingress-canary/ingress-canary-c26k6"
Aug 04 00:03:15.553890 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.553862    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05049a1e-914e-4f3a-977d-b26019f4cab7-tmp-dir\") pod \"dns-default-p75vz\" (UID: \"05049a1e-914e-4f3a-977d-b26019f4cab7\") " pod="openshift-dns/dns-default-p75vz"
Aug 04 00:03:15.554000 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.553919    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05049a1e-914e-4f3a-977d-b26019f4cab7-config-volume\") pod \"dns-default-p75vz\" (UID: \"05049a1e-914e-4f3a-977d-b26019f4cab7\") " pod="openshift-dns/dns-default-p75vz"
Aug 04 00:03:15.555830 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.555809    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05049a1e-914e-4f3a-977d-b26019f4cab7-metrics-tls\") pod \"dns-default-p75vz\" (UID: \"05049a1e-914e-4f3a-977d-b26019f4cab7\") " pod="openshift-dns/dns-default-p75vz"
Aug 04 00:03:15.556023 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.556006    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab18aa19-3c52-4b0d-81ca-b492f1c1a2d3-cert\") pod \"ingress-canary-c26k6\" (UID: \"ab18aa19-3c52-4b0d-81ca-b492f1c1a2d3\") " pod="openshift-ingress-canary/ingress-canary-c26k6"
Aug 04 00:03:15.561408 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.561380    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nh55\" (UniqueName: \"kubernetes.io/projected/ab18aa19-3c52-4b0d-81ca-b492f1c1a2d3-kube-api-access-9nh55\") pod \"ingress-canary-c26k6\" (UID: \"ab18aa19-3c52-4b0d-81ca-b492f1c1a2d3\") " pod="openshift-ingress-canary/ingress-canary-c26k6"
Aug 04 00:03:15.561638 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.561621    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t2bt\" (UniqueName: \"kubernetes.io/projected/05049a1e-914e-4f3a-977d-b26019f4cab7-kube-api-access-6t2bt\") pod \"dns-default-p75vz\" (UID: \"05049a1e-914e-4f3a-977d-b26019f4cab7\") " pod="openshift-dns/dns-default-p75vz"
Aug 04 00:03:15.563491 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.563476    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p75vz"
Aug 04 00:03:15.633843 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.633796    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c26k6"
Aug 04 00:03:15.764960 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.764899    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p75vz"]
Aug 04 00:03:15.768608 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:03:15.768578    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05049a1e_914e_4f3a_977d_b26019f4cab7.slice/crio-6840268dd72f9e2d02e096928dc75ff05b6d7591fd359c034be3f7e80e69b243 WatchSource:0}: Error finding container 6840268dd72f9e2d02e096928dc75ff05b6d7591fd359c034be3f7e80e69b243: Status 404 returned error can't find the container with id 6840268dd72f9e2d02e096928dc75ff05b6d7591fd359c034be3f7e80e69b243
Aug 04 00:03:15.791332 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.791308    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cjtcl"]
Aug 04 00:03:15.806684 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:15.806660    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c26k6"]
Aug 04 00:03:15.809427 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:03:15.809404    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab18aa19_3c52_4b0d_81ca_b492f1c1a2d3.slice/crio-7787d3f70beae138777aa46626e7f3bc8a36e38d82b0a155c226f1724b133ceb WatchSource:0}: Error finding container 7787d3f70beae138777aa46626e7f3bc8a36e38d82b0a155c226f1724b133ceb: Status 404 returned error can't find the container with id 7787d3f70beae138777aa46626e7f3bc8a36e38d82b0a155c226f1724b133ceb
Aug 04 00:03:16.505756 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:16.505705    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c26k6" event={"ID":"ab18aa19-3c52-4b0d-81ca-b492f1c1a2d3","Type":"ContainerStarted","Data":"7787d3f70beae138777aa46626e7f3bc8a36e38d82b0a155c226f1724b133ceb"}
Aug 04 00:03:16.507338 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:16.507273    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p75vz" event={"ID":"05049a1e-914e-4f3a-977d-b26019f4cab7","Type":"ContainerStarted","Data":"6840268dd72f9e2d02e096928dc75ff05b6d7591fd359c034be3f7e80e69b243"}
Aug 04 00:03:16.510047 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:16.510019    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cjtcl" event={"ID":"e100a5f8-1a98-4c96-8dd5-0c490c60e06c","Type":"ContainerStarted","Data":"0f070b7d7e877b044f9567fa839f87584eaa65bb5240f8eeb15f4a849fe16b16"}
Aug 04 00:03:16.510146 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:16.510074    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cjtcl" event={"ID":"e100a5f8-1a98-4c96-8dd5-0c490c60e06c","Type":"ContainerStarted","Data":"33deab6b323a1469fe0f816389a41c462873c3d93786650484205bbbbaf12aaa"}
Aug 04 00:03:17.515352 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.515322    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cjtcl" event={"ID":"e100a5f8-1a98-4c96-8dd5-0c490c60e06c","Type":"ContainerStarted","Data":"e114c9cbfdd766744d1bdf89733f6c47fe48bfa5778790a0a1a8ca5a9d39c46f"}
Aug 04 00:03:17.795798 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.795708    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5765dcb8b5-p9hs9"]
Aug 04 00:03:17.797889 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.797864    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:03:17.800320 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.800294    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Aug 04 00:03:17.801072 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.801046    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Aug 04 00:03:17.801183 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.801084    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Aug 04 00:03:17.801932 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.801464    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Aug 04 00:03:17.801932 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.801518    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Aug 04 00:03:17.801932 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.801590    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Aug 04 00:03:17.801932 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.801729    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Aug 04 00:03:17.801932 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.801780    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-np8dz\""
Aug 04 00:03:17.812010 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.811980    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5765dcb8b5-p9hs9"]
Aug 04 00:03:17.870820 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.870784    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b7dadd0-0ba9-487a-8b53-4a292313353b-oauth-serving-cert\") pod \"console-5765dcb8b5-p9hs9\" (UID: \"2b7dadd0-0ba9-487a-8b53-4a292313353b\") " pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:03:17.870963 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.870892    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b7dadd0-0ba9-487a-8b53-4a292313353b-console-oauth-config\") pod \"console-5765dcb8b5-p9hs9\" (UID: \"2b7dadd0-0ba9-487a-8b53-4a292313353b\") " pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:03:17.871030 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.870963    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b7dadd0-0ba9-487a-8b53-4a292313353b-service-ca\") pod \"console-5765dcb8b5-p9hs9\" (UID: \"2b7dadd0-0ba9-487a-8b53-4a292313353b\") " pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:03:17.871030 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.870999    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b7dadd0-0ba9-487a-8b53-4a292313353b-console-config\") pod \"console-5765dcb8b5-p9hs9\" (UID: \"2b7dadd0-0ba9-487a-8b53-4a292313353b\") " pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:03:17.871030 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.871023    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz5cz\" (UniqueName: \"kubernetes.io/projected/2b7dadd0-0ba9-487a-8b53-4a292313353b-kube-api-access-wz5cz\") pod \"console-5765dcb8b5-p9hs9\" (UID: \"2b7dadd0-0ba9-487a-8b53-4a292313353b\") " pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:03:17.871195 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.871061    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b7dadd0-0ba9-487a-8b53-4a292313353b-console-serving-cert\") pod \"console-5765dcb8b5-p9hs9\" (UID: \"2b7dadd0-0ba9-487a-8b53-4a292313353b\") " pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:03:17.926253 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.926218    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-sbhb4"]
Aug 04 00:03:17.928421 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.928329    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-sbhb4"
Aug 04 00:03:17.931071 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.930895    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Aug 04 00:03:17.931071 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.930930    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 04 00:03:17.931071 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.930945    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 04 00:03:17.931071 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.930984    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-wzlxn\""
Aug 04 00:03:17.931341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.931238    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Aug 04 00:03:17.931341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.931269    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 04 00:03:17.940343 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.940319    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-sbhb4"]
Aug 04 00:03:17.971684 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.971658    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b7dadd0-0ba9-487a-8b53-4a292313353b-console-serving-cert\") pod \"console-5765dcb8b5-p9hs9\" (UID: \"2b7dadd0-0ba9-487a-8b53-4a292313353b\") " pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:03:17.971833 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.971698    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2992e377-b62b-4fa7-a2ce-826fc6f74056-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-sbhb4\" (UID: \"2992e377-b62b-4fa7-a2ce-826fc6f74056\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sbhb4"
Aug 04 00:03:17.971833 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.971739    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2992e377-b62b-4fa7-a2ce-826fc6f74056-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-sbhb4\" (UID: \"2992e377-b62b-4fa7-a2ce-826fc6f74056\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sbhb4"
Aug 04 00:03:17.971833 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.971807    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b7dadd0-0ba9-487a-8b53-4a292313353b-oauth-serving-cert\") pod \"console-5765dcb8b5-p9hs9\" (UID: \"2b7dadd0-0ba9-487a-8b53-4a292313353b\") " pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:03:17.972017 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.971840    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq6j6\" (UniqueName: \"kubernetes.io/projected/2992e377-b62b-4fa7-a2ce-826fc6f74056-kube-api-access-bq6j6\") pod \"prometheus-operator-758d7cb874-sbhb4\" (UID: \"2992e377-b62b-4fa7-a2ce-826fc6f74056\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sbhb4"
Aug 04 00:03:17.972017 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.971892    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b7dadd0-0ba9-487a-8b53-4a292313353b-console-oauth-config\") pod \"console-5765dcb8b5-p9hs9\" (UID: \"2b7dadd0-0ba9-487a-8b53-4a292313353b\") " pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:03:17.972017 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.971923    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2992e377-b62b-4fa7-a2ce-826fc6f74056-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-sbhb4\" (UID: \"2992e377-b62b-4fa7-a2ce-826fc6f74056\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sbhb4"
Aug 04 00:03:17.972017 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.971950    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b7dadd0-0ba9-487a-8b53-4a292313353b-service-ca\") pod \"console-5765dcb8b5-p9hs9\" (UID: \"2b7dadd0-0ba9-487a-8b53-4a292313353b\") " pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:03:17.972017 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.971976    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b7dadd0-0ba9-487a-8b53-4a292313353b-console-config\") pod \"console-5765dcb8b5-p9hs9\" (UID: \"2b7dadd0-0ba9-487a-8b53-4a292313353b\") " pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:03:17.972017 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.971997    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz5cz\" (UniqueName: \"kubernetes.io/projected/2b7dadd0-0ba9-487a-8b53-4a292313353b-kube-api-access-wz5cz\") pod \"console-5765dcb8b5-p9hs9\" (UID: \"2b7dadd0-0ba9-487a-8b53-4a292313353b\") " pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:03:17.972731 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.972687    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b7dadd0-0ba9-487a-8b53-4a292313353b-service-ca\") pod \"console-5765dcb8b5-p9hs9\" (UID: \"2b7dadd0-0ba9-487a-8b53-4a292313353b\") " pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:03:17.974828 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.974756    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b7dadd0-0ba9-487a-8b53-4a292313353b-console-serving-cert\") pod \"console-5765dcb8b5-p9hs9\" (UID: \"2b7dadd0-0ba9-487a-8b53-4a292313353b\") " pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:03:17.974828 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.974775    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b7dadd0-0ba9-487a-8b53-4a292313353b-oauth-serving-cert\") pod \"console-5765dcb8b5-p9hs9\" (UID: \"2b7dadd0-0ba9-487a-8b53-4a292313353b\") " pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:03:17.974985 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.974828    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b7dadd0-0ba9-487a-8b53-4a292313353b-console-config\") pod \"console-5765dcb8b5-p9hs9\" (UID: \"2b7dadd0-0ba9-487a-8b53-4a292313353b\") " pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:03:17.975168 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.975149    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b7dadd0-0ba9-487a-8b53-4a292313353b-console-oauth-config\") pod \"console-5765dcb8b5-p9hs9\" (UID: \"2b7dadd0-0ba9-487a-8b53-4a292313353b\") " pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:03:17.981597 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:17.981573    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz5cz\" (UniqueName: \"kubernetes.io/projected/2b7dadd0-0ba9-487a-8b53-4a292313353b-kube-api-access-wz5cz\") pod \"console-5765dcb8b5-p9hs9\" (UID: \"2b7dadd0-0ba9-487a-8b53-4a292313353b\") " pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:03:18.073139 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:18.073061    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2992e377-b62b-4fa7-a2ce-826fc6f74056-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-sbhb4\" (UID: \"2992e377-b62b-4fa7-a2ce-826fc6f74056\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sbhb4"
Aug 04 00:03:18.073139 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:18.073098    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2992e377-b62b-4fa7-a2ce-826fc6f74056-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-sbhb4\" (UID: \"2992e377-b62b-4fa7-a2ce-826fc6f74056\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sbhb4"
Aug 04 00:03:18.073331 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:18.073258    2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Aug 04 00:03:18.073379 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:18.073335    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2992e377-b62b-4fa7-a2ce-826fc6f74056-prometheus-operator-tls podName:2992e377-b62b-4fa7-a2ce-826fc6f74056 nodeName:}" failed. No retries permitted until 2026-08-04 00:03:18.573313482 +0000 UTC m=+52.741950833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/2992e377-b62b-4fa7-a2ce-826fc6f74056-prometheus-operator-tls") pod "prometheus-operator-758d7cb874-sbhb4" (UID: "2992e377-b62b-4fa7-a2ce-826fc6f74056") : secret "prometheus-operator-tls" not found
Aug 04 00:03:18.073459 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:18.073259    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq6j6\" (UniqueName: \"kubernetes.io/projected/2992e377-b62b-4fa7-a2ce-826fc6f74056-kube-api-access-bq6j6\") pod \"prometheus-operator-758d7cb874-sbhb4\" (UID: \"2992e377-b62b-4fa7-a2ce-826fc6f74056\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sbhb4"
Aug 04 00:03:18.073553 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:18.073534    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2992e377-b62b-4fa7-a2ce-826fc6f74056-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-sbhb4\" (UID: \"2992e377-b62b-4fa7-a2ce-826fc6f74056\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sbhb4"
Aug 04 00:03:18.073870 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:18.073852    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2992e377-b62b-4fa7-a2ce-826fc6f74056-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-sbhb4\" (UID: \"2992e377-b62b-4fa7-a2ce-826fc6f74056\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sbhb4"
Aug 04 00:03:18.076081 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:18.076056    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2992e377-b62b-4fa7-a2ce-826fc6f74056-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-sbhb4\" (UID: \"2992e377-b62b-4fa7-a2ce-826fc6f74056\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sbhb4"
Aug 04 00:03:18.082216 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:18.082195    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq6j6\" (UniqueName: \"kubernetes.io/projected/2992e377-b62b-4fa7-a2ce-826fc6f74056-kube-api-access-bq6j6\") pod \"prometheus-operator-758d7cb874-sbhb4\" (UID: \"2992e377-b62b-4fa7-a2ce-826fc6f74056\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sbhb4"
Aug 04 00:03:18.110082 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:18.110054    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:03:18.578115 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:18.578071    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2992e377-b62b-4fa7-a2ce-826fc6f74056-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-sbhb4\" (UID: \"2992e377-b62b-4fa7-a2ce-826fc6f74056\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sbhb4"
Aug 04 00:03:18.580877 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:18.580848    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2992e377-b62b-4fa7-a2ce-826fc6f74056-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-sbhb4\" (UID: \"2992e377-b62b-4fa7-a2ce-826fc6f74056\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sbhb4"
Aug 04 00:03:18.735917 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:18.735845    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5765dcb8b5-p9hs9"]
Aug 04 00:03:18.740317 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:03:18.740221    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b7dadd0_0ba9_487a_8b53_4a292313353b.slice/crio-77f421e37d05ff991f8a18a7771c47a853d1bc46e38b8d6f75109d87ee69226a WatchSource:0}: Error finding container 77f421e37d05ff991f8a18a7771c47a853d1bc46e38b8d6f75109d87ee69226a: Status 404 returned error can't find the container with id 77f421e37d05ff991f8a18a7771c47a853d1bc46e38b8d6f75109d87ee69226a
Aug 04 00:03:18.840881 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:18.840811    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-sbhb4"
Aug 04 00:03:18.963165 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:18.963138    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-sbhb4"]
Aug 04 00:03:18.966313 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:03:18.966278    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2992e377_b62b_4fa7_a2ce_826fc6f74056.slice/crio-575cf79060bfa846cc14efe59b9b3e65825c1718c888307d33a275d01c425490 WatchSource:0}: Error finding container 575cf79060bfa846cc14efe59b9b3e65825c1718c888307d33a275d01c425490: Status 404 returned error can't find the container with id 575cf79060bfa846cc14efe59b9b3e65825c1718c888307d33a275d01c425490
Aug 04 00:03:19.523690 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:19.523415    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c26k6" event={"ID":"ab18aa19-3c52-4b0d-81ca-b492f1c1a2d3","Type":"ContainerStarted","Data":"4eecd2fcea7cfaa1beaff67775c6623ce29bd835edde7105796a450176d04628"}
Aug 04 00:03:19.525444 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:19.525413    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p75vz" event={"ID":"05049a1e-914e-4f3a-977d-b26019f4cab7","Type":"ContainerStarted","Data":"3281986eebbefc27250a54075930c8954097e0c308b3cdf760d7b8251416af1c"}
Aug 04 00:03:19.525595 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:19.525472    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p75vz" event={"ID":"05049a1e-914e-4f3a-977d-b26019f4cab7","Type":"ContainerStarted","Data":"044c3a74608bb0b8f1d8f4535008a146f2ba276ba7840d157729797b27873fcd"}
Aug 04 00:03:19.525595 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:19.525529    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-p75vz"
Aug 04 00:03:19.527000 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:19.526947    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-sbhb4" event={"ID":"2992e377-b62b-4fa7-a2ce-826fc6f74056","Type":"ContainerStarted","Data":"575cf79060bfa846cc14efe59b9b3e65825c1718c888307d33a275d01c425490"}
Aug 04 00:03:19.528382 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:19.528358    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5765dcb8b5-p9hs9" event={"ID":"2b7dadd0-0ba9-487a-8b53-4a292313353b","Type":"ContainerStarted","Data":"77f421e37d05ff991f8a18a7771c47a853d1bc46e38b8d6f75109d87ee69226a"}
Aug 04 00:03:19.531094 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:19.531070    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cjtcl" event={"ID":"e100a5f8-1a98-4c96-8dd5-0c490c60e06c","Type":"ContainerStarted","Data":"09c8a824e7d730d2996f45d54494c3200ecf4cfe2a7fef6a2c65eb655686e731"}
Aug 04 00:03:19.541341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:19.541216    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-c26k6" podStartSLOduration=1.727948958 podStartE2EDuration="4.541201908s" totalImagesPullingTime="2.81325295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:03:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:19.540837449 +0000 UTC m=+53.709474820" watchObservedRunningTime="2026-08-04 00:03:19.541201908 +0000 UTC m=+53.709839277"
Aug 04 00:03:19.558165 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:19.558114    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-p75vz" podStartSLOduration=1.7254575220000001 podStartE2EDuration="4.558094766s" totalImagesPullingTime="2.832637244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:03:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:19.557652769 +0000 UTC m=+53.726290160" watchObservedRunningTime="2026-08-04 00:03:19.558094766 +0000 UTC m=+53.726732137"
Aug 04 00:03:19.576253 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:19.576202    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cjtcl" podStartSLOduration=1.886376545 podStartE2EDuration="4.576188788s" totalImagesPullingTime="2.689812243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:03:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:19.575042267 +0000 UTC m=+53.743679638" watchObservedRunningTime="2026-08-04 00:03:19.576188788 +0000 UTC m=+53.744826159"
Aug 04 00:03:20.540317 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:20.540243    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-sbhb4" event={"ID":"2992e377-b62b-4fa7-a2ce-826fc6f74056","Type":"ContainerStarted","Data":"2354439c90f83dc6bb037ce09b5534416cb6dda25f1801b2e3ccf78abfd88f58"}
Aug 04 00:03:20.540768 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:20.540356    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-sbhb4" event={"ID":"2992e377-b62b-4fa7-a2ce-826fc6f74056","Type":"ContainerStarted","Data":"981c28ad4226bd4c77d3c9aa326f46bbd3d6ff681cfb779756c57aa8090d6b5c"}
Aug 04 00:03:20.557617 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:20.557565    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-sbhb4" podStartSLOduration=2.3520552820000002 podStartE2EDuration="3.557544927s" totalImagesPullingTime="1.205489645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:03:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:20.556241364 +0000 UTC m=+54.724878736" watchObservedRunningTime="2026-08-04 00:03:20.557544927 +0000 UTC m=+54.726182298"
Aug 04 00:03:22.257993 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.257963    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-9tvk5"]
Aug 04 00:03:22.292480 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.292450    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-9tvk5"]
Aug 04 00:03:22.292632 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.292503    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp"]
Aug 04 00:03:22.292681 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.292649    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-9tvk5"
Aug 04 00:03:22.295052 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.295024    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Aug 04 00:03:22.295052 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.295037    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-sqg4l\""
Aug 04 00:03:22.295223 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.295060    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Aug 04 00:03:22.306312 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.306278    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp"
Aug 04 00:03:22.308565 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.308538    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Aug 04 00:03:22.308696 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.308543    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Aug 04 00:03:22.308696 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.308543    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Aug 04 00:03:22.308865 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.308804    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-qhrdd\""
Aug 04 00:03:22.310555 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.310538    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vk6lq"]
Aug 04 00:03:22.312002 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.311979    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fba4244d-9288-475b-b6b4-4fadeab11e97-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-9tvk5\" (UID: \"fba4244d-9288-475b-b6b4-4fadeab11e97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-9tvk5"
Aug 04 00:03:22.312111 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.312033    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fba4244d-9288-475b-b6b4-4fadeab11e97-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-9tvk5\" (UID: \"fba4244d-9288-475b-b6b4-4fadeab11e97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-9tvk5"
Aug 04 00:03:22.312111 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.312062    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7twp\" (UniqueName: \"kubernetes.io/projected/fba4244d-9288-475b-b6b4-4fadeab11e97-kube-api-access-p7twp\") pod \"openshift-state-metrics-6bb4d7b4dd-9tvk5\" (UID: \"fba4244d-9288-475b-b6b4-4fadeab11e97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-9tvk5"
Aug 04 00:03:22.312225 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.312116    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fba4244d-9288-475b-b6b4-4fadeab11e97-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-9tvk5\" (UID: \"fba4244d-9288-475b-b6b4-4fadeab11e97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-9tvk5"
Aug 04 00:03:22.332475 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.332452    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp"]
Aug 04 00:03:22.332594 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.332577    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.334906 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.334889    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 04 00:03:22.335019 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.334917    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 04 00:03:22.335019 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.334944    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 04 00:03:22.335131 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.335046    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zm4p5\""
Aug 04 00:03:22.412663 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.412627    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fba4244d-9288-475b-b6b4-4fadeab11e97-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-9tvk5\" (UID: \"fba4244d-9288-475b-b6b4-4fadeab11e97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-9tvk5"
Aug 04 00:03:22.412663 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.412667    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f803ae9-0f3e-47fb-85f4-59a3742c5097-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-nz9jp\" (UID: \"4f803ae9-0f3e-47fb-85f4-59a3742c5097\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp"
Aug 04 00:03:22.412871 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.412688    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gxd9\" (UniqueName: \"kubernetes.io/projected/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-kube-api-access-8gxd9\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.412871 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.412741    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-root\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.412871 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.412764    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-metrics-client-ca\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.412871 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.412803    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4f803ae9-0f3e-47fb-85f4-59a3742c5097-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-nz9jp\" (UID: \"4f803ae9-0f3e-47fb-85f4-59a3742c5097\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp"
Aug 04 00:03:22.412871 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.412845    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f803ae9-0f3e-47fb-85f4-59a3742c5097-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-nz9jp\" (UID: \"4f803ae9-0f3e-47fb-85f4-59a3742c5097\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp"
Aug 04 00:03:22.413017 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.412880    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-sys\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.413017 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.412929    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fba4244d-9288-475b-b6b4-4fadeab11e97-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-9tvk5\" (UID: \"fba4244d-9288-475b-b6b4-4fadeab11e97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-9tvk5"
Aug 04 00:03:22.413017 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.412947    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fba4244d-9288-475b-b6b4-4fadeab11e97-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-9tvk5\" (UID: \"fba4244d-9288-475b-b6b4-4fadeab11e97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-9tvk5"
Aug 04 00:03:22.413017 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.412986    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-node-exporter-textfile\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.413017 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.413005    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f803ae9-0f3e-47fb-85f4-59a3742c5097-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-nz9jp\" (UID: \"4f803ae9-0f3e-47fb-85f4-59a3742c5097\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp"
Aug 04 00:03:22.413193 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.413029    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-node-exporter-accelerators-collector-config\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.413193 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:22.413033    2556 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Aug 04 00:03:22.413193 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.413061    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq4p7\" (UniqueName: \"kubernetes.io/projected/4f803ae9-0f3e-47fb-85f4-59a3742c5097-kube-api-access-nq4p7\") pod \"kube-state-metrics-6bd9664c4-nz9jp\" (UID: \"4f803ae9-0f3e-47fb-85f4-59a3742c5097\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp"
Aug 04 00:03:22.413193 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:22.413101    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fba4244d-9288-475b-b6b4-4fadeab11e97-openshift-state-metrics-tls podName:fba4244d-9288-475b-b6b4-4fadeab11e97 nodeName:}" failed. No retries permitted until 2026-08-04 00:03:22.913081602 +0000 UTC m=+57.081718962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/fba4244d-9288-475b-b6b4-4fadeab11e97-openshift-state-metrics-tls") pod "openshift-state-metrics-6bb4d7b4dd-9tvk5" (UID: "fba4244d-9288-475b-b6b4-4fadeab11e97") : secret "openshift-state-metrics-tls" not found
Aug 04 00:03:22.413193 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.413120    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-node-exporter-tls\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.413391 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.413148    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.413748 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.413509    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4f803ae9-0f3e-47fb-85f4-59a3742c5097-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-nz9jp\" (UID: \"4f803ae9-0f3e-47fb-85f4-59a3742c5097\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp"
Aug 04 00:03:22.413748 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.413671    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7twp\" (UniqueName: \"kubernetes.io/projected/fba4244d-9288-475b-b6b4-4fadeab11e97-kube-api-access-p7twp\") pod \"openshift-state-metrics-6bb4d7b4dd-9tvk5\" (UID: \"fba4244d-9288-475b-b6b4-4fadeab11e97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-9tvk5"
Aug 04 00:03:22.413945 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.413860    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fba4244d-9288-475b-b6b4-4fadeab11e97-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-9tvk5\" (UID: \"fba4244d-9288-475b-b6b4-4fadeab11e97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-9tvk5"
Aug 04 00:03:22.414589 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.414036    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-node-exporter-wtmp\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.417849 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.417823    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fba4244d-9288-475b-b6b4-4fadeab11e97-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-9tvk5\" (UID: \"fba4244d-9288-475b-b6b4-4fadeab11e97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-9tvk5"
Aug 04 00:03:22.421531 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.421506    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7twp\" (UniqueName: \"kubernetes.io/projected/fba4244d-9288-475b-b6b4-4fadeab11e97-kube-api-access-p7twp\") pod \"openshift-state-metrics-6bb4d7b4dd-9tvk5\" (UID: \"fba4244d-9288-475b-b6b4-4fadeab11e97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-9tvk5"
Aug 04 00:03:22.514612 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.514523    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-node-exporter-wtmp\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.514612 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.514570    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f803ae9-0f3e-47fb-85f4-59a3742c5097-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-nz9jp\" (UID: \"4f803ae9-0f3e-47fb-85f4-59a3742c5097\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp"
Aug 04 00:03:22.514612 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.514601    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gxd9\" (UniqueName: \"kubernetes.io/projected/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-kube-api-access-8gxd9\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.514917 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.514627    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-root\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.514917 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.514649    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-metrics-client-ca\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.514917 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.514677    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4f803ae9-0f3e-47fb-85f4-59a3742c5097-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-nz9jp\" (UID: \"4f803ae9-0f3e-47fb-85f4-59a3742c5097\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp"
Aug 04 00:03:22.514917 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.514697    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f803ae9-0f3e-47fb-85f4-59a3742c5097-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-nz9jp\" (UID: \"4f803ae9-0f3e-47fb-85f4-59a3742c5097\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp"
Aug 04 00:03:22.514917 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.514709    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-node-exporter-wtmp\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.514917 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.514740    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-sys\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.514917 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.514753    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-root\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.514917 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.514814    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-sys\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.514917 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.514880    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-node-exporter-textfile\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.514917 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.514909    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f803ae9-0f3e-47fb-85f4-59a3742c5097-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-nz9jp\" (UID: \"4f803ae9-0f3e-47fb-85f4-59a3742c5097\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp"
Aug 04 00:03:22.515439 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.514948    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-node-exporter-accelerators-collector-config\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.515439 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.514988    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq4p7\" (UniqueName: \"kubernetes.io/projected/4f803ae9-0f3e-47fb-85f4-59a3742c5097-kube-api-access-nq4p7\") pod \"kube-state-metrics-6bd9664c4-nz9jp\" (UID: \"4f803ae9-0f3e-47fb-85f4-59a3742c5097\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp"
Aug 04 00:03:22.515439 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.515027    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-node-exporter-tls\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.515439 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.515052    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.515439 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.515084    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4f803ae9-0f3e-47fb-85f4-59a3742c5097-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-nz9jp\" (UID: \"4f803ae9-0f3e-47fb-85f4-59a3742c5097\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp"
Aug 04 00:03:22.515439 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.515089    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4f803ae9-0f3e-47fb-85f4-59a3742c5097-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-nz9jp\" (UID: \"4f803ae9-0f3e-47fb-85f4-59a3742c5097\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp"
Aug 04 00:03:22.515439 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:22.515221    2556 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Aug 04 00:03:22.515439 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:22.515279    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-node-exporter-tls podName:c553ca6a-a9b4-4e6d-85af-666c7f19c2d2 nodeName:}" failed. No retries permitted until 2026-08-04 00:03:23.015260049 +0000 UTC m=+57.183897403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-node-exporter-tls") pod "node-exporter-vk6lq" (UID: "c553ca6a-a9b4-4e6d-85af-666c7f19c2d2") : secret "node-exporter-tls" not found
Aug 04 00:03:22.515439 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.515315    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-metrics-client-ca\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.515439 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.515353    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-node-exporter-textfile\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.515862 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.515512    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f803ae9-0f3e-47fb-85f4-59a3742c5097-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-nz9jp\" (UID: \"4f803ae9-0f3e-47fb-85f4-59a3742c5097\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp"
Aug 04 00:03:22.515862 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.515518    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-node-exporter-accelerators-collector-config\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.515862 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.515676    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4f803ae9-0f3e-47fb-85f4-59a3742c5097-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-nz9jp\" (UID: \"4f803ae9-0f3e-47fb-85f4-59a3742c5097\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp"
Aug 04 00:03:22.517448 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.517420    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f803ae9-0f3e-47fb-85f4-59a3742c5097-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-nz9jp\" (UID: \"4f803ae9-0f3e-47fb-85f4-59a3742c5097\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp"
Aug 04 00:03:22.517558 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.517463    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.517595 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.517578    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f803ae9-0f3e-47fb-85f4-59a3742c5097-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-nz9jp\" (UID: \"4f803ae9-0f3e-47fb-85f4-59a3742c5097\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp"
Aug 04 00:03:22.523390 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.523364    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gxd9\" (UniqueName: \"kubernetes.io/projected/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-kube-api-access-8gxd9\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:22.523479 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.523442    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq4p7\" (UniqueName: \"kubernetes.io/projected/4f803ae9-0f3e-47fb-85f4-59a3742c5097-kube-api-access-nq4p7\") pod \"kube-state-metrics-6bd9664c4-nz9jp\" (UID: \"4f803ae9-0f3e-47fb-85f4-59a3742c5097\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp"
Aug 04 00:03:22.549305 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.549278    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5765dcb8b5-p9hs9" event={"ID":"2b7dadd0-0ba9-487a-8b53-4a292313353b","Type":"ContainerStarted","Data":"0ebb55b62a79ec9c9370287b3a8adc4ff8e86a11816efddf04dae63673ff372d"}
Aug 04 00:03:22.565483 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.565431    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5765dcb8b5-p9hs9" podStartSLOduration=2.779949751 podStartE2EDuration="5.56541556s" totalImagesPullingTime="2.785465809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:03:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:22.564944524 +0000 UTC m=+56.733581908" watchObservedRunningTime="2026-08-04 00:03:22.56541556 +0000 UTC m=+56.734052930"
Aug 04 00:03:22.615640 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.615607    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp"
Aug 04 00:03:22.764895 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.764869    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp"]
Aug 04 00:03:22.767446 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:03:22.767420    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f803ae9_0f3e_47fb_85f4_59a3742c5097.slice/crio-6b4c0abcec6804434c140f464d80b58864ce0be1d4910b85d8e8ca566a7c8706 WatchSource:0}: Error finding container 6b4c0abcec6804434c140f464d80b58864ce0be1d4910b85d8e8ca566a7c8706: Status 404 returned error can't find the container with id 6b4c0abcec6804434c140f464d80b58864ce0be1d4910b85d8e8ca566a7c8706
Aug 04 00:03:22.917404 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.917372    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fba4244d-9288-475b-b6b4-4fadeab11e97-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-9tvk5\" (UID: \"fba4244d-9288-475b-b6b4-4fadeab11e97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-9tvk5"
Aug 04 00:03:22.919680 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:22.919658    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fba4244d-9288-475b-b6b4-4fadeab11e97-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-9tvk5\" (UID: \"fba4244d-9288-475b-b6b4-4fadeab11e97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-9tvk5"
Aug 04 00:03:23.018112 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.018032    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-node-exporter-tls\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:23.020280 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.020260    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c553ca6a-a9b4-4e6d-85af-666c7f19c2d2-node-exporter-tls\") pod \"node-exporter-vk6lq\" (UID: \"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2\") " pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:23.201384 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.201350    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-9tvk5"
Aug 04 00:03:23.240342 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.240319    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vk6lq"
Aug 04 00:03:23.283029 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:03:23.282891    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc553ca6a_a9b4_4e6d_85af_666c7f19c2d2.slice/crio-4b117b6f21430e3f861e427dda6913dc8556e688ac432ef490ef18094c68906b WatchSource:0}: Error finding container 4b117b6f21430e3f861e427dda6913dc8556e688ac432ef490ef18094c68906b: Status 404 returned error can't find the container with id 4b117b6f21430e3f861e427dda6913dc8556e688ac432ef490ef18094c68906b
Aug 04 00:03:23.335777 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.335743    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 00:03:23.358937 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.358871    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 00:03:23.359115 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.359078    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.361527 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.361503    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Aug 04 00:03:23.361673 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.361542    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Aug 04 00:03:23.362548 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.361815    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Aug 04 00:03:23.362548 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.361895    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Aug 04 00:03:23.362548 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.361907    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lv5q2\""
Aug 04 00:03:23.362548 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.362028    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Aug 04 00:03:23.362548 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.362202    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Aug 04 00:03:23.362548 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.362209    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Aug 04 00:03:23.362548 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.362283    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Aug 04 00:03:23.362548 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.362415    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Aug 04 00:03:23.375648 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.375625    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-9tvk5"]
Aug 04 00:03:23.378698 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:03:23.378673    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfba4244d_9288_475b_b6b4_4fadeab11e97.slice/crio-661794a17f8ae87735ab2fc7a856975ebae56b5c1f5bf0970db5f8e45cce7386 WatchSource:0}: Error finding container 661794a17f8ae87735ab2fc7a856975ebae56b5c1f5bf0970db5f8e45cce7386: Status 404 returned error can't find the container with id 661794a17f8ae87735ab2fc7a856975ebae56b5c1f5bf0970db5f8e45cce7386
Aug 04 00:03:23.420802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.420773    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wft5v\" (UniqueName: \"kubernetes.io/projected/1437e594-4eae-42ee-9097-2e6c0a37132e-kube-api-access-wft5v\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.420935 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.420836    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1437e594-4eae-42ee-9097-2e6c0a37132e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.420935 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.420909    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1437e594-4eae-42ee-9097-2e6c0a37132e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.421025 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.420941    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.421025 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.420975    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.421105 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.421041    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.421105 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.421076    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.421179 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.421102    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1437e594-4eae-42ee-9097-2e6c0a37132e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.421179 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.421151    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1437e594-4eae-42ee-9097-2e6c0a37132e-config-out\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.421286 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.421175    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.421286 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.421199    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-web-config\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.421286 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.421225    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1437e594-4eae-42ee-9097-2e6c0a37132e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.421286 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.421246    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-config-volume\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.521662 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.521634    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1437e594-4eae-42ee-9097-2e6c0a37132e-config-out\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.521811 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.521676    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.521811 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.521722    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-web-config\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.521811 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.521756    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1437e594-4eae-42ee-9097-2e6c0a37132e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.521811 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.521789    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-config-volume\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.522013 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.521842    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wft5v\" (UniqueName: \"kubernetes.io/projected/1437e594-4eae-42ee-9097-2e6c0a37132e-kube-api-access-wft5v\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.522013 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.521895    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1437e594-4eae-42ee-9097-2e6c0a37132e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.522013 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.521928    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1437e594-4eae-42ee-9097-2e6c0a37132e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.522013 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.521954    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.522013 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.521980    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.522247 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.522020    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.522247 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.522050    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.522247 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.522074    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1437e594-4eae-42ee-9097-2e6c0a37132e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.523247 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.522957    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1437e594-4eae-42ee-9097-2e6c0a37132e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.523247 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.523014    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1437e594-4eae-42ee-9097-2e6c0a37132e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.523247 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.523156    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1437e594-4eae-42ee-9097-2e6c0a37132e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.523444 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:23.523257    2556 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Aug 04 00:03:23.523444 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:03:23.523311    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-main-tls podName:1437e594-4eae-42ee-9097-2e6c0a37132e nodeName:}" failed. No retries permitted until 2026-08-04 00:03:24.023290546 +0000 UTC m=+58.191927897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "1437e594-4eae-42ee-9097-2e6c0a37132e") : secret "alertmanager-main-tls" not found
Aug 04 00:03:23.525602 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.525540    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-web-config\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.525602 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.525552    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1437e594-4eae-42ee-9097-2e6c0a37132e-config-out\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.526453 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.526429    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.526656 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.526594    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.527169 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.527142    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1437e594-4eae-42ee-9097-2e6c0a37132e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.528022 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.527977    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.528163 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.528141    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-config-volume\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.529331 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.529313    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.533978 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.533956    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wft5v\" (UniqueName: \"kubernetes.io/projected/1437e594-4eae-42ee-9097-2e6c0a37132e-kube-api-access-wft5v\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:23.554551 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.554520    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vk6lq" event={"ID":"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2","Type":"ContainerStarted","Data":"4b117b6f21430e3f861e427dda6913dc8556e688ac432ef490ef18094c68906b"}
Aug 04 00:03:23.555902 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.555866    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp" event={"ID":"4f803ae9-0f3e-47fb-85f4-59a3742c5097","Type":"ContainerStarted","Data":"6b4c0abcec6804434c140f464d80b58864ce0be1d4910b85d8e8ca566a7c8706"}
Aug 04 00:03:23.557673 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.557582    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-9tvk5" event={"ID":"fba4244d-9288-475b-b6b4-4fadeab11e97","Type":"ContainerStarted","Data":"76407c94cf974de9daac0afe3443b1fe7433bd9db7171757fc19439a8d2f7838"}
Aug 04 00:03:23.557673 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:23.557630    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-9tvk5" event={"ID":"fba4244d-9288-475b-b6b4-4fadeab11e97","Type":"ContainerStarted","Data":"661794a17f8ae87735ab2fc7a856975ebae56b5c1f5bf0970db5f8e45cce7386"}
Aug 04 00:03:24.028475 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:24.028440    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:24.030732 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:24.030691    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:24.271988 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:24.271959    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:03:24.448171 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:24.447658    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 00:03:24.496558 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:03:24.496519    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1437e594_4eae_42ee_9097_2e6c0a37132e.slice/crio-d49dee9f3c997e7df26ca30b2593cbaee20b9f930e0667677a3d228a19ffb56a WatchSource:0}: Error finding container d49dee9f3c997e7df26ca30b2593cbaee20b9f930e0667677a3d228a19ffb56a: Status 404 returned error can't find the container with id d49dee9f3c997e7df26ca30b2593cbaee20b9f930e0667677a3d228a19ffb56a
Aug 04 00:03:24.562433 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:24.562400    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1437e594-4eae-42ee-9097-2e6c0a37132e","Type":"ContainerStarted","Data":"d49dee9f3c997e7df26ca30b2593cbaee20b9f930e0667677a3d228a19ffb56a"}
Aug 04 00:03:24.564367 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:24.564322    2556 generic.go:356] "Generic (PLEG): container finished" podID="c553ca6a-a9b4-4e6d-85af-666c7f19c2d2" containerID="f1ef4ee283a6c7a3f05ac6000b0a8387fb399f1631630584a980ba4430bfb28f" exitCode=0
Aug 04 00:03:24.564456 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:24.564443    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vk6lq" event={"ID":"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2","Type":"ContainerDied","Data":"f1ef4ee283a6c7a3f05ac6000b0a8387fb399f1631630584a980ba4430bfb28f"}
Aug 04 00:03:24.569153 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:24.569098    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp" event={"ID":"4f803ae9-0f3e-47fb-85f4-59a3742c5097","Type":"ContainerStarted","Data":"d6a65ed15f94b866dab1ba89578e47bd0f826205eca6feb8b6f83d7599ec3baf"}
Aug 04 00:03:24.569242 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:24.569182    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp" event={"ID":"4f803ae9-0f3e-47fb-85f4-59a3742c5097","Type":"ContainerStarted","Data":"42f2377223eb7882745b81cb4592dcc66385ed8a77ad6d909d4b79021225cc7a"}
Aug 04 00:03:24.569242 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:24.569209    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp" event={"ID":"4f803ae9-0f3e-47fb-85f4-59a3742c5097","Type":"ContainerStarted","Data":"331dc7651f0c574b8a45706fee3e7ab0590f0e3b7fc2c0c45bdaecea621d2d2c"}
Aug 04 00:03:24.572200 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:24.572180    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-9tvk5" event={"ID":"fba4244d-9288-475b-b6b4-4fadeab11e97","Type":"ContainerStarted","Data":"6fb23f397f2aa669a9bf373ff74bdf3479778bd13654689a766e5529d1ae5784"}
Aug 04 00:03:24.599595 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:24.599546    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-nz9jp" podStartSLOduration=1.119883025 podStartE2EDuration="2.599530458s" totalImagesPullingTime="1.479647433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:03:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:24.59813146 +0000 UTC m=+58.766768832" watchObservedRunningTime="2026-08-04 00:03:24.599530458 +0000 UTC m=+58.768167828"
Aug 04 00:03:25.257038 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.257001    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-775c96d4fb-n7l57"]
Aug 04 00:03:25.259863 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.259839    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.262921 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.262896    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Aug 04 00:03:25.263046 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.262937    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Aug 04 00:03:25.263046 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.262897    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Aug 04 00:03:25.263046 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.263040    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Aug 04 00:03:25.263202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.262950    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Aug 04 00:03:25.263260 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.263244    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9mhn1j9n2oq8n\""
Aug 04 00:03:25.263524 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.263507    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-h7mv8\""
Aug 04 00:03:25.272591 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.272572    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-775c96d4fb-n7l57"]
Aug 04 00:03:25.340675 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.340632    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72f65aad-a515-4dc7-8f26-b87c3938268b-metrics-client-ca\") pod \"thanos-querier-775c96d4fb-n7l57\" (UID: \"72f65aad-a515-4dc7-8f26-b87c3938268b\") " pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.340869 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.340725    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/72f65aad-a515-4dc7-8f26-b87c3938268b-secret-thanos-querier-tls\") pod \"thanos-querier-775c96d4fb-n7l57\" (UID: \"72f65aad-a515-4dc7-8f26-b87c3938268b\") " pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.340869 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.340782    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/72f65aad-a515-4dc7-8f26-b87c3938268b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-775c96d4fb-n7l57\" (UID: \"72f65aad-a515-4dc7-8f26-b87c3938268b\") " pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.340869 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.340859    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72f65aad-a515-4dc7-8f26-b87c3938268b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-775c96d4fb-n7l57\" (UID: \"72f65aad-a515-4dc7-8f26-b87c3938268b\") " pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.341056 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.340953    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72f65aad-a515-4dc7-8f26-b87c3938268b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-775c96d4fb-n7l57\" (UID: \"72f65aad-a515-4dc7-8f26-b87c3938268b\") " pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.341056 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.340992    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cff7n\" (UniqueName: \"kubernetes.io/projected/72f65aad-a515-4dc7-8f26-b87c3938268b-kube-api-access-cff7n\") pod \"thanos-querier-775c96d4fb-n7l57\" (UID: \"72f65aad-a515-4dc7-8f26-b87c3938268b\") " pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.341056 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.341019    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/72f65aad-a515-4dc7-8f26-b87c3938268b-secret-grpc-tls\") pod \"thanos-querier-775c96d4fb-n7l57\" (UID: \"72f65aad-a515-4dc7-8f26-b87c3938268b\") " pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.341056 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.341048    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/72f65aad-a515-4dc7-8f26-b87c3938268b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-775c96d4fb-n7l57\" (UID: \"72f65aad-a515-4dc7-8f26-b87c3938268b\") " pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.442436 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.442073    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/72f65aad-a515-4dc7-8f26-b87c3938268b-secret-thanos-querier-tls\") pod \"thanos-querier-775c96d4fb-n7l57\" (UID: \"72f65aad-a515-4dc7-8f26-b87c3938268b\") " pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.442436 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.442183    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/72f65aad-a515-4dc7-8f26-b87c3938268b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-775c96d4fb-n7l57\" (UID: \"72f65aad-a515-4dc7-8f26-b87c3938268b\") " pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.442436 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.442261    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72f65aad-a515-4dc7-8f26-b87c3938268b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-775c96d4fb-n7l57\" (UID: \"72f65aad-a515-4dc7-8f26-b87c3938268b\") " pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.442436 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.442357    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72f65aad-a515-4dc7-8f26-b87c3938268b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-775c96d4fb-n7l57\" (UID: \"72f65aad-a515-4dc7-8f26-b87c3938268b\") " pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.442436 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.442382    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cff7n\" (UniqueName: \"kubernetes.io/projected/72f65aad-a515-4dc7-8f26-b87c3938268b-kube-api-access-cff7n\") pod \"thanos-querier-775c96d4fb-n7l57\" (UID: \"72f65aad-a515-4dc7-8f26-b87c3938268b\") " pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.442436 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.442423    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/72f65aad-a515-4dc7-8f26-b87c3938268b-secret-grpc-tls\") pod \"thanos-querier-775c96d4fb-n7l57\" (UID: \"72f65aad-a515-4dc7-8f26-b87c3938268b\") " pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.442890 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.442451    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/72f65aad-a515-4dc7-8f26-b87c3938268b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-775c96d4fb-n7l57\" (UID: \"72f65aad-a515-4dc7-8f26-b87c3938268b\") " pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.442890 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.442506    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72f65aad-a515-4dc7-8f26-b87c3938268b-metrics-client-ca\") pod \"thanos-querier-775c96d4fb-n7l57\" (UID: \"72f65aad-a515-4dc7-8f26-b87c3938268b\") " pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.443365 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.443308    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72f65aad-a515-4dc7-8f26-b87c3938268b-metrics-client-ca\") pod \"thanos-querier-775c96d4fb-n7l57\" (UID: \"72f65aad-a515-4dc7-8f26-b87c3938268b\") " pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.445684 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.445496    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72f65aad-a515-4dc7-8f26-b87c3938268b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-775c96d4fb-n7l57\" (UID: \"72f65aad-a515-4dc7-8f26-b87c3938268b\") " pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.445934 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.445884    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72f65aad-a515-4dc7-8f26-b87c3938268b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-775c96d4fb-n7l57\" (UID: \"72f65aad-a515-4dc7-8f26-b87c3938268b\") " pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.446497 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.446467    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/72f65aad-a515-4dc7-8f26-b87c3938268b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-775c96d4fb-n7l57\" (UID: \"72f65aad-a515-4dc7-8f26-b87c3938268b\") " pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.446699 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.446682    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/72f65aad-a515-4dc7-8f26-b87c3938268b-secret-thanos-querier-tls\") pod \"thanos-querier-775c96d4fb-n7l57\" (UID: \"72f65aad-a515-4dc7-8f26-b87c3938268b\") " pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.446799 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.446780    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/72f65aad-a515-4dc7-8f26-b87c3938268b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-775c96d4fb-n7l57\" (UID: \"72f65aad-a515-4dc7-8f26-b87c3938268b\") " pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.447061 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.447040    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/72f65aad-a515-4dc7-8f26-b87c3938268b-secret-grpc-tls\") pod \"thanos-querier-775c96d4fb-n7l57\" (UID: \"72f65aad-a515-4dc7-8f26-b87c3938268b\") " pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.450770 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.450745    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cff7n\" (UniqueName: \"kubernetes.io/projected/72f65aad-a515-4dc7-8f26-b87c3938268b-kube-api-access-cff7n\") pod \"thanos-querier-775c96d4fb-n7l57\" (UID: \"72f65aad-a515-4dc7-8f26-b87c3938268b\") " pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.465065 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.465043    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7mbxb"
Aug 04 00:03:25.570511 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.570432    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:25.586220 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.586189    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vk6lq" event={"ID":"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2","Type":"ContainerStarted","Data":"e0f0a5cb6823a7d35a5a377e45907b3dc6a1827648c2800b1cb493633a102679"}
Aug 04 00:03:25.586367 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.586329    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vk6lq" event={"ID":"c553ca6a-a9b4-4e6d-85af-666c7f19c2d2","Type":"ContainerStarted","Data":"6c7a051cb3d3faf97795dad6126554dc90f81d5c324aaac1abf90357692fee19"}
Aug 04 00:03:25.588555 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.588522    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-9tvk5" event={"ID":"fba4244d-9288-475b-b6b4-4fadeab11e97","Type":"ContainerStarted","Data":"f0e82a11f117fdd0421b41ee00453a5947cb0f6e73247a2d60412857f17d0012"}
Aug 04 00:03:25.608355 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.608304    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vk6lq" podStartSLOduration=2.539538098 podStartE2EDuration="3.608283669s" totalImagesPullingTime="965.972488ms" totalInitContainerRuntime="102.773083ms" isStatefulPod=true podCreationTimestamp="2026-08-04 00:03:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:25.607544888 +0000 UTC m=+59.776182261" watchObservedRunningTime="2026-08-04 00:03:25.608283669 +0000 UTC m=+59.776921041"
Aug 04 00:03:25.629545 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.628435    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-9tvk5" podStartSLOduration=2.455134953 podStartE2EDuration="3.628413442s" totalImagesPullingTime="1.173278489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:03:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:25.626787906 +0000 UTC m=+59.795425277" watchObservedRunningTime="2026-08-04 00:03:25.628413442 +0000 UTC m=+59.797050812"
Aug 04 00:03:25.713388 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:25.713361    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-775c96d4fb-n7l57"]
Aug 04 00:03:25.735485 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:03:25.735460    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72f65aad_a515_4dc7_8f26_b87c3938268b.slice/crio-046c8065d36af972414bfa5e604510682e0462057417caaa1b63aed600aeda99 WatchSource:0}: Error finding container 046c8065d36af972414bfa5e604510682e0462057417caaa1b63aed600aeda99: Status 404 returned error can't find the container with id 046c8065d36af972414bfa5e604510682e0462057417caaa1b63aed600aeda99
Aug 04 00:03:26.597239 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:26.597203    2556 generic.go:356] "Generic (PLEG): container finished" podID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerID="161a657decc92cae7ef94e6f07ef3bd3442b9efd951d4687d021d5ae610f8b40" exitCode=0
Aug 04 00:03:26.597658 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:26.597286    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1437e594-4eae-42ee-9097-2e6c0a37132e","Type":"ContainerDied","Data":"161a657decc92cae7ef94e6f07ef3bd3442b9efd951d4687d021d5ae610f8b40"}
Aug 04 00:03:26.598412 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:26.598359    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57" event={"ID":"72f65aad-a515-4dc7-8f26-b87c3938268b","Type":"ContainerStarted","Data":"046c8065d36af972414bfa5e604510682e0462057417caaa1b63aed600aeda99"}
Aug 04 00:03:27.994227 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:27.994196    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54689d648b-zmhsv"]
Aug 04 00:03:27.997371 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:27.997348    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:28.007206 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.007178    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54689d648b-zmhsv"]
Aug 04 00:03:28.007462 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.007439    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Aug 04 00:03:28.066089 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.066046    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-trusted-ca-bundle\") pod \"console-54689d648b-zmhsv\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") " pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:28.066089 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.066082    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-console-oauth-config\") pod \"console-54689d648b-zmhsv\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") " pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:28.066173 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.066151    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-console-serving-cert\") pod \"console-54689d648b-zmhsv\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") " pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:28.066173 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.066168    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-service-ca\") pod \"console-54689d648b-zmhsv\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") " pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:28.066235 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.066207    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-oauth-serving-cert\") pod \"console-54689d648b-zmhsv\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") " pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:28.066268 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.066224    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnbww\" (UniqueName: \"kubernetes.io/projected/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-kube-api-access-wnbww\") pod \"console-54689d648b-zmhsv\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") " pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:28.066268 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.066256    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-console-config\") pod \"console-54689d648b-zmhsv\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") " pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:28.110337 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.110308    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:03:28.110444 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.110372    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:03:28.111824 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.111796    2556 patch_prober.go:28] interesting pod/console-5765dcb8b5-p9hs9 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body=
Aug 04 00:03:28.111935 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.111837    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5765dcb8b5-p9hs9" podUID="2b7dadd0-0ba9-487a-8b53-4a292313353b" containerName="console" probeResult="failure" output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused"
Aug 04 00:03:28.166837 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.166812    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-oauth-serving-cert\") pod \"console-54689d648b-zmhsv\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") " pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:28.166954 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.166849    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnbww\" (UniqueName: \"kubernetes.io/projected/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-kube-api-access-wnbww\") pod \"console-54689d648b-zmhsv\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") " pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:28.166954 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.166890    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-console-config\") pod \"console-54689d648b-zmhsv\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") " pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:28.167056 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.166978    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-trusted-ca-bundle\") pod \"console-54689d648b-zmhsv\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") " pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:28.167056 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.167020    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-console-oauth-config\") pod \"console-54689d648b-zmhsv\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") " pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:28.167166 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.167097    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-console-serving-cert\") pod \"console-54689d648b-zmhsv\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") " pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:28.167166 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.167125    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-service-ca\") pod \"console-54689d648b-zmhsv\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") " pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:28.167814 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.167787    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-console-config\") pod \"console-54689d648b-zmhsv\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") " pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:28.168922 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.167929    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-service-ca\") pod \"console-54689d648b-zmhsv\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") " pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:28.168922 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.168439    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-oauth-serving-cert\") pod \"console-54689d648b-zmhsv\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") " pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:28.169212 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.169184    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-trusted-ca-bundle\") pod \"console-54689d648b-zmhsv\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") " pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:28.170944 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.170917    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-console-oauth-config\") pod \"console-54689d648b-zmhsv\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") " pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:28.171657 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.171634    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-console-serving-cert\") pod \"console-54689d648b-zmhsv\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") " pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:28.176911 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.176876    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnbww\" (UniqueName: \"kubernetes.io/projected/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-kube-api-access-wnbww\") pod \"console-54689d648b-zmhsv\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") " pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:28.311296 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.310813    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:28.471819 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.471792    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54689d648b-zmhsv"]
Aug 04 00:03:28.475477 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:03:28.475456    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71af9c9d_3ad9_4dcc_bec2_a5923fb3162b.slice/crio-da456dbe9c8d366ba507d9d7bea2d38efcb3c03bb666999f10bb5c47623fab6c WatchSource:0}: Error finding container da456dbe9c8d366ba507d9d7bea2d38efcb3c03bb666999f10bb5c47623fab6c: Status 404 returned error can't find the container with id da456dbe9c8d366ba507d9d7bea2d38efcb3c03bb666999f10bb5c47623fab6c
Aug 04 00:03:28.562131 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.562098    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 00:03:28.573060 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.572976    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.576311 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.576288    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Aug 04 00:03:28.576500 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.576316    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Aug 04 00:03:28.576886 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.576864    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Aug 04 00:03:28.577060 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.577039    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Aug 04 00:03:28.577195 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.576445    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Aug 04 00:03:28.577293 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.576697    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Aug 04 00:03:28.577370 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.576937    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Aug 04 00:03:28.577433 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.576989    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Aug 04 00:03:28.577522 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.577187    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Aug 04 00:03:28.577583 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.576396    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Aug 04 00:03:28.577632 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.576536    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-20rua064mmps2\""
Aug 04 00:03:28.581827 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.579043    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Aug 04 00:03:28.581827 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.579181    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Aug 04 00:03:28.581827 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.579330    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Aug 04 00:03:28.581827 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.580210    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Aug 04 00:03:28.581827 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.581359    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Aug 04 00:03:28.581827 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.581805    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vqnw5\""
Aug 04 00:03:28.591970 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.591921    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 00:03:28.613518 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.613484    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54689d648b-zmhsv" event={"ID":"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b","Type":"ContainerStarted","Data":"e49cf210450d81e6af69087c1635ba0e3a7e888e4e4a83fc96f1b26938c5e22a"}
Aug 04 00:03:28.613688 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.613542    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54689d648b-zmhsv" event={"ID":"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b","Type":"ContainerStarted","Data":"da456dbe9c8d366ba507d9d7bea2d38efcb3c03bb666999f10bb5c47623fab6c"}
Aug 04 00:03:28.620607 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.620583    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1437e594-4eae-42ee-9097-2e6c0a37132e","Type":"ContainerStarted","Data":"5495419370b83dad337b4e58c58ed7f645f1c2588a6349b33153a562d6817b4c"}
Aug 04 00:03:28.620836 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.620818    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1437e594-4eae-42ee-9097-2e6c0a37132e","Type":"ContainerStarted","Data":"2e09b61782cc6ed2b4f22fdd50096956b26d6b724a6660200ab3560be7dc524d"}
Aug 04 00:03:28.620976 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.620963    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1437e594-4eae-42ee-9097-2e6c0a37132e","Type":"ContainerStarted","Data":"d3401ea2b477e7b90f4d7a5f53ea9e5e3800765bb80b123348c86635607e4ec8"}
Aug 04 00:03:28.621085 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.621071    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1437e594-4eae-42ee-9097-2e6c0a37132e","Type":"ContainerStarted","Data":"996d8dd7e213a937e2c39f23e56bcbd5313c186436412ed43df9021376519606"}
Aug 04 00:03:28.621198 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.621185    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1437e594-4eae-42ee-9097-2e6c0a37132e","Type":"ContainerStarted","Data":"0a58962c2513a55312e627da1d0ea505f03c3a195620d1c1b6fe39c1b18b8bdd"}
Aug 04 00:03:28.631519 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.631468    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54689d648b-zmhsv" podStartSLOduration=1.631449661 podStartE2EDuration="1.631449661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:03:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:28.630840499 +0000 UTC m=+62.799478085" watchObservedRunningTime="2026-08-04 00:03:28.631449661 +0000 UTC m=+62.800087027"
Aug 04 00:03:28.673192 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.673152    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.673361 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.673202    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcczr\" (UniqueName: \"kubernetes.io/projected/6289e73d-ceb9-453b-9bf4-c35aba2f744c-kube-api-access-lcczr\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.673361 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.673267    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6289e73d-ceb9-453b-9bf4-c35aba2f744c-config-out\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.673361 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.673293    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.673523 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.673419    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.673523 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.673491    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-config\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.673633 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.673532    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-web-config\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.673633 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.673594    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.673775 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.673672    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.673838 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.673799    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.673897 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.673842    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.674153 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.674122    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.674253 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.674162    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.674253 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.674202    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.674253 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.674226    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.674426 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.674251    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.674426 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.674352    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.674426 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.674390    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.674574 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.674446    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6289e73d-ceb9-453b-9bf4-c35aba2f744c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.674574 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.674481    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.776786 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.775437    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.776786 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.775491    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.776786 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.775533    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.776786 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.775558    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.776786 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.775582    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.776786 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.775617    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.776786 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.775640    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.776786 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.775664    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.776786 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.775735    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.776786 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.775765    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.776786 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.775802    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6289e73d-ceb9-453b-9bf4-c35aba2f744c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.776786 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.775832    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.776786 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.775860    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.776786 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.775883    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcczr\" (UniqueName: \"kubernetes.io/projected/6289e73d-ceb9-453b-9bf4-c35aba2f744c-kube-api-access-lcczr\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.776786 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.775922    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6289e73d-ceb9-453b-9bf4-c35aba2f744c-config-out\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.776786 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.775944    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.776786 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.775989    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.777738 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.776017    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-config\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.777738 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.776039    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-web-config\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.777738 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.776083    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.777738 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.777573    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.777955 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.777748    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.777955 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.777765    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.779311 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.778424    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.779311 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.778754    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.779311 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.778993    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.779311 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.779221    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.780252 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.780224    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6289e73d-ceb9-453b-9bf4-c35aba2f744c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.781314 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.781264    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.781424 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.781405    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.782457 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.782362    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.782457 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.782408    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-config\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.782457 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.782427    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.785048 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.785023    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-web-config\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.785393 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.785355    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6289e73d-ceb9-453b-9bf4-c35aba2f744c-config-out\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.785518 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.785497    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.785583 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.785516    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.785583 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.785521    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.785583 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.785546    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.790501 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.790473    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcczr\" (UniqueName: \"kubernetes.io/projected/6289e73d-ceb9-453b-9bf4-c35aba2f744c-kube-api-access-lcczr\") pod \"prometheus-k8s-0\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:28.887002 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:28.886971    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:03:29.053191 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:29.053101    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 00:03:29.056840 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:03:29.056812    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6289e73d_ceb9_453b_9bf4_c35aba2f744c.slice/crio-8953ab393a441e9ec6b4868c258d5fffc09ea666b08dd7cd4c4dd09299a17b55 WatchSource:0}: Error finding container 8953ab393a441e9ec6b4868c258d5fffc09ea666b08dd7cd4c4dd09299a17b55: Status 404 returned error can't find the container with id 8953ab393a441e9ec6b4868c258d5fffc09ea666b08dd7cd4c4dd09299a17b55
Aug 04 00:03:29.542813 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:29.542779    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-p75vz"
Aug 04 00:03:29.626494 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:29.626446    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6289e73d-ceb9-453b-9bf4-c35aba2f744c","Type":"ContainerStarted","Data":"b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6"}
Aug 04 00:03:29.626647 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:29.626533    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6289e73d-ceb9-453b-9bf4-c35aba2f744c","Type":"ContainerStarted","Data":"8953ab393a441e9ec6b4868c258d5fffc09ea666b08dd7cd4c4dd09299a17b55"}
Aug 04 00:03:30.631590 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:30.631557    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57" event={"ID":"72f65aad-a515-4dc7-8f26-b87c3938268b","Type":"ContainerStarted","Data":"3732b20f750a62d75b4b1f262e5a0a74cd5c1fd1c84eec2f3288b1e322d2b79e"}
Aug 04 00:03:30.631945 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:30.631633    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57" event={"ID":"72f65aad-a515-4dc7-8f26-b87c3938268b","Type":"ContainerStarted","Data":"4bb39b65350dc7d95abaf6f38cf997aaea269294a6472a8bd49d61572dd27c29"}
Aug 04 00:03:30.633091 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:30.633069    2556 generic.go:356] "Generic (PLEG): container finished" podID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerID="b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6" exitCode=0
Aug 04 00:03:30.633184 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:30.633150    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6289e73d-ceb9-453b-9bf4-c35aba2f744c","Type":"ContainerDied","Data":"b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6"}
Aug 04 00:03:30.636523 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:30.636503    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1437e594-4eae-42ee-9097-2e6c0a37132e","Type":"ContainerStarted","Data":"fc6144e431ac3645dd25a2f67117213cf0458c77f311d5f0d31feee66f5b6fa0"}
Aug 04 00:03:30.690274 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:30.690230    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.173333068 podStartE2EDuration="7.690213195s" totalImagesPullingTime="4.496620476s" totalInitContainerRuntime="20.259651ms" isStatefulPod=false podCreationTimestamp="2026-08-04 00:03:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:30.688695988 +0000 UTC m=+64.857333360" watchObservedRunningTime="2026-08-04 00:03:30.690213195 +0000 UTC m=+64.858850564"
Aug 04 00:03:31.096025 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.095939    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d8005c-382d-442b-bdda-ab4af6df878f-metrics-certs\") pod \"network-metrics-daemon-wx48v\" (UID: \"46d8005c-382d-442b-bdda-ab4af6df878f\") " pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:03:31.096178 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.096092    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1c75c58e-ca1e-40b0-8993-9a91f8214235-original-pull-secret\") pod \"global-pull-secret-syncer-hw9ff\" (UID: \"1c75c58e-ca1e-40b0-8993-9a91f8214235\") " pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:03:31.098358 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.098337    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 00:03:31.098488 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.098438    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 00:03:31.108423 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.108403    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d8005c-382d-442b-bdda-ab4af6df878f-metrics-certs\") pod \"network-metrics-daemon-wx48v\" (UID: \"46d8005c-382d-442b-bdda-ab4af6df878f\") " pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:03:31.108423 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.108412    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1c75c58e-ca1e-40b0-8993-9a91f8214235-original-pull-secret\") pod \"global-pull-secret-syncer-hw9ff\" (UID: \"1c75c58e-ca1e-40b0-8993-9a91f8214235\") " pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:03:31.197006 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.196977    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48wjr\" (UniqueName: \"kubernetes.io/projected/d9bc22fa-fb2f-46ee-a049-614b16402835-kube-api-access-48wjr\") pod \"network-check-target-xqvmz\" (UID: \"d9bc22fa-fb2f-46ee-a049-614b16402835\") " pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:03:31.199466 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.199448    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 00:03:31.209950 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.209925    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 00:03:31.215887 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.215865    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9ff"
Aug 04 00:03:31.222332 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.222278    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48wjr\" (UniqueName: \"kubernetes.io/projected/d9bc22fa-fb2f-46ee-a049-614b16402835-kube-api-access-48wjr\") pod \"network-check-target-xqvmz\" (UID: \"d9bc22fa-fb2f-46ee-a049-614b16402835\") " pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:03:31.223005 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.222978    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j4cq2\""
Aug 04 00:03:31.230925 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.230904    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx48v"
Aug 04 00:03:31.368560 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.368172    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hw9ff"]
Aug 04 00:03:31.371258 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:03:31.371211    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c75c58e_ca1e_40b0_8993_9a91f8214235.slice/crio-000483afb2f20002624bec44b01745266f29f3a17fdb3a73b3e7a3c5ad060af0 WatchSource:0}: Error finding container 000483afb2f20002624bec44b01745266f29f3a17fdb3a73b3e7a3c5ad060af0: Status 404 returned error can't find the container with id 000483afb2f20002624bec44b01745266f29f3a17fdb3a73b3e7a3c5ad060af0
Aug 04 00:03:31.386873 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.386851    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wx48v"]
Aug 04 00:03:31.389745 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:03:31.389697    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46d8005c_382d_442b_bdda_ab4af6df878f.slice/crio-eaffbf456eceefeeeb4eb637a6d45b162eb74c53f2f5739b0a432308f0fdb2e8 WatchSource:0}: Error finding container eaffbf456eceefeeeb4eb637a6d45b162eb74c53f2f5739b0a432308f0fdb2e8: Status 404 returned error can't find the container with id eaffbf456eceefeeeb4eb637a6d45b162eb74c53f2f5739b0a432308f0fdb2e8
Aug 04 00:03:31.513247 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.513213    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l74qs\""
Aug 04 00:03:31.521206 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.521177    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:03:31.647762 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.646886    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57" event={"ID":"72f65aad-a515-4dc7-8f26-b87c3938268b","Type":"ContainerStarted","Data":"17c6dfecd680a80448028672bbd5b441b6df1e0319548c6999c3ee64881f94d7"}
Aug 04 00:03:31.647762 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.647005    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57" event={"ID":"72f65aad-a515-4dc7-8f26-b87c3938268b","Type":"ContainerStarted","Data":"021115292b679f14b8dac016d0f2e7b7fbb20ec1b765d373d929626b906a062e"}
Aug 04 00:03:31.647762 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.647161    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:31.647762 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.647240    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57" event={"ID":"72f65aad-a515-4dc7-8f26-b87c3938268b","Type":"ContainerStarted","Data":"895985ae22945112434d21136252398678647a3a21d923a2d9e8f2c507680aa6"}
Aug 04 00:03:31.647762 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.647286    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57" event={"ID":"72f65aad-a515-4dc7-8f26-b87c3938268b","Type":"ContainerStarted","Data":"84ab0cb6bf4a57243c43aecdfc14c4a4db9d586978e7a9e43657aa213de97210"}
Aug 04 00:03:31.648469 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.648441    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wx48v" event={"ID":"46d8005c-382d-442b-bdda-ab4af6df878f","Type":"ContainerStarted","Data":"eaffbf456eceefeeeb4eb637a6d45b162eb74c53f2f5739b0a432308f0fdb2e8"}
Aug 04 00:03:31.649774 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.649741    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hw9ff" event={"ID":"1c75c58e-ca1e-40b0-8993-9a91f8214235","Type":"ContainerStarted","Data":"000483afb2f20002624bec44b01745266f29f3a17fdb3a73b3e7a3c5ad060af0"}
Aug 04 00:03:31.673177 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.672915    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57" podStartSLOduration=2.06400988 podStartE2EDuration="6.672896985s" totalImagesPullingTime="4.608887105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:31.671424495 +0000 UTC m=+65.840061865" watchObservedRunningTime="2026-08-04 00:03:31.672896985 +0000 UTC m=+65.841534352"
Aug 04 00:03:31.675833 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:31.675677    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xqvmz"]
Aug 04 00:03:31.680602 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:03:31.680579    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9bc22fa_fb2f_46ee_a049_614b16402835.slice/crio-5cb315072297b294d5cc126b14ac6f6f1788f5d94055c995f75fb4e053e6d0d5 WatchSource:0}: Error finding container 5cb315072297b294d5cc126b14ac6f6f1788f5d94055c995f75fb4e053e6d0d5: Status 404 returned error can't find the container with id 5cb315072297b294d5cc126b14ac6f6f1788f5d94055c995f75fb4e053e6d0d5
Aug 04 00:03:32.657314 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:32.657218    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wx48v" event={"ID":"46d8005c-382d-442b-bdda-ab4af6df878f","Type":"ContainerStarted","Data":"de3ab36ed498364c8e086ce48adb7fd6d56696df2ec67136a78d312a9917b6d9"}
Aug 04 00:03:32.660816 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:32.660778    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xqvmz" event={"ID":"d9bc22fa-fb2f-46ee-a049-614b16402835","Type":"ContainerStarted","Data":"5cb315072297b294d5cc126b14ac6f6f1788f5d94055c995f75fb4e053e6d0d5"}
Aug 04 00:03:33.671886 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:33.671804    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wx48v" event={"ID":"46d8005c-382d-442b-bdda-ab4af6df878f","Type":"ContainerStarted","Data":"c89c882d909890b1d620d0ad974b0e3259a0fa78a415f170d45ad3fef3044ef2"}
Aug 04 00:03:33.686619 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:33.686525    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wx48v" podStartSLOduration=66.572107445 podStartE2EDuration="1m7.686503089s" totalImagesPullingTime="1.114395644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:33.686211781 +0000 UTC m=+67.854849153" watchObservedRunningTime="2026-08-04 00:03:33.686503089 +0000 UTC m=+67.855140460"
Aug 04 00:03:34.680546 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:34.680443    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6289e73d-ceb9-453b-9bf4-c35aba2f744c","Type":"ContainerStarted","Data":"2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080"}
Aug 04 00:03:34.680546 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:34.680517    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6289e73d-ceb9-453b-9bf4-c35aba2f744c","Type":"ContainerStarted","Data":"1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5"}
Aug 04 00:03:34.681031 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:34.680565    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6289e73d-ceb9-453b-9bf4-c35aba2f744c","Type":"ContainerStarted","Data":"e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e"}
Aug 04 00:03:34.681031 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:34.680605    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6289e73d-ceb9-453b-9bf4-c35aba2f744c","Type":"ContainerStarted","Data":"4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93"}
Aug 04 00:03:34.681031 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:34.680643    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6289e73d-ceb9-453b-9bf4-c35aba2f744c","Type":"ContainerStarted","Data":"269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b"}
Aug 04 00:03:34.681031 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:34.680670    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6289e73d-ceb9-453b-9bf4-c35aba2f744c","Type":"ContainerStarted","Data":"54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16"}
Aug 04 00:03:34.709948 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:34.709116    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.174783809 podStartE2EDuration="6.70909686s" totalImagesPullingTime="3.513015092s" totalInitContainerRuntime="21.297959ms" isStatefulPod=false podCreationTimestamp="2026-08-04 00:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:34.706406488 +0000 UTC m=+68.875043869" watchObservedRunningTime="2026-08-04 00:03:34.70909686 +0000 UTC m=+68.877734231"
Aug 04 00:03:37.666869 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:37.666840    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-775c96d4fb-n7l57"
Aug 04 00:03:37.699848 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:37.699806    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xqvmz" event={"ID":"d9bc22fa-fb2f-46ee-a049-614b16402835","Type":"ContainerStarted","Data":"11fb5ccdc7be34cc7ee34da9c529ebda0ca50222b2d71909e752e97d2e5e506b"}
Aug 04 00:03:37.700017 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:37.699932    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:03:37.701536 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:37.701506    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hw9ff" event={"ID":"1c75c58e-ca1e-40b0-8993-9a91f8214235","Type":"ContainerStarted","Data":"89bd1d47e3883860c3a009678901c2cd0955d3e80f415a755feb14c4ba8485ef"}
Aug 04 00:03:37.715511 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:37.715456    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xqvmz" podStartSLOduration=66.173408166 podStartE2EDuration="1m11.715440012s" totalImagesPullingTime="5.542031846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:37.714217999 +0000 UTC m=+71.882855372" watchObservedRunningTime="2026-08-04 00:03:37.715440012 +0000 UTC m=+71.884077381"
Aug 04 00:03:37.728729 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:37.728664    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hw9ff" podStartSLOduration=65.876774527 podStartE2EDuration="1m11.728621819s" totalImagesPullingTime="5.851847292s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 00:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:03:37.727957631 +0000 UTC m=+71.896595001" watchObservedRunningTime="2026-08-04 00:03:37.728621819 +0000 UTC m=+71.897259188"
Aug 04 00:03:38.114435 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:38.114405    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:03:38.118364 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:38.118340    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:03:38.311169 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:38.311138    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:38.311314 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:38.311191    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:38.316796 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:38.316771    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:38.711181 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:38.711154    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:03:38.765689 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:38.764990    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5765dcb8b5-p9hs9"]
Aug 04 00:03:38.888075 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:03:38.888029    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:04.729356 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:04.729312    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5765dcb8b5-p9hs9" podUID="2b7dadd0-0ba9-487a-8b53-4a292313353b" containerName="console" containerID="cri-o://0ebb55b62a79ec9c9370287b3a8adc4ff8e86a11816efddf04dae63673ff372d" gracePeriod=15
Aug 04 00:04:05.001383 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.001326    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:04:05.098946 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.098919    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b7dadd0-0ba9-487a-8b53-4a292313353b-console-oauth-config\") pod \"2b7dadd0-0ba9-487a-8b53-4a292313353b\" (UID: \"2b7dadd0-0ba9-487a-8b53-4a292313353b\") "
Aug 04 00:04:05.099089 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.098960    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b7dadd0-0ba9-487a-8b53-4a292313353b-console-serving-cert\") pod \"2b7dadd0-0ba9-487a-8b53-4a292313353b\" (UID: \"2b7dadd0-0ba9-487a-8b53-4a292313353b\") "
Aug 04 00:04:05.099089 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.099035    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wz5cz\" (UniqueName: \"kubernetes.io/projected/2b7dadd0-0ba9-487a-8b53-4a292313353b-kube-api-access-wz5cz\") pod \"2b7dadd0-0ba9-487a-8b53-4a292313353b\" (UID: \"2b7dadd0-0ba9-487a-8b53-4a292313353b\") "
Aug 04 00:04:05.099089 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.099071    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b7dadd0-0ba9-487a-8b53-4a292313353b-oauth-serving-cert\") pod \"2b7dadd0-0ba9-487a-8b53-4a292313353b\" (UID: \"2b7dadd0-0ba9-487a-8b53-4a292313353b\") "
Aug 04 00:04:05.099205 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.099095    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b7dadd0-0ba9-487a-8b53-4a292313353b-service-ca\") pod \"2b7dadd0-0ba9-487a-8b53-4a292313353b\" (UID: \"2b7dadd0-0ba9-487a-8b53-4a292313353b\") "
Aug 04 00:04:05.099205 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.099112    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b7dadd0-0ba9-487a-8b53-4a292313353b-console-config\") pod \"2b7dadd0-0ba9-487a-8b53-4a292313353b\" (UID: \"2b7dadd0-0ba9-487a-8b53-4a292313353b\") "
Aug 04 00:04:05.099498 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.099458    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b7dadd0-0ba9-487a-8b53-4a292313353b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2b7dadd0-0ba9-487a-8b53-4a292313353b" (UID: "2b7dadd0-0ba9-487a-8b53-4a292313353b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:04:05.099648 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.099484    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b7dadd0-0ba9-487a-8b53-4a292313353b-service-ca" (OuterVolumeSpecName: "service-ca") pod "2b7dadd0-0ba9-487a-8b53-4a292313353b" (UID: "2b7dadd0-0ba9-487a-8b53-4a292313353b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:04:05.099648 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.099523    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b7dadd0-0ba9-487a-8b53-4a292313353b-console-config" (OuterVolumeSpecName: "console-config") pod "2b7dadd0-0ba9-487a-8b53-4a292313353b" (UID: "2b7dadd0-0ba9-487a-8b53-4a292313353b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:04:05.101306 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.101285    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b7dadd0-0ba9-487a-8b53-4a292313353b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2b7dadd0-0ba9-487a-8b53-4a292313353b" (UID: "2b7dadd0-0ba9-487a-8b53-4a292313353b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:04:05.101391 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.101354    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b7dadd0-0ba9-487a-8b53-4a292313353b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2b7dadd0-0ba9-487a-8b53-4a292313353b" (UID: "2b7dadd0-0ba9-487a-8b53-4a292313353b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:04:05.101391 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.101354    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b7dadd0-0ba9-487a-8b53-4a292313353b-kube-api-access-wz5cz" (OuterVolumeSpecName: "kube-api-access-wz5cz") pod "2b7dadd0-0ba9-487a-8b53-4a292313353b" (UID: "2b7dadd0-0ba9-487a-8b53-4a292313353b"). InnerVolumeSpecName "kube-api-access-wz5cz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:04:05.199995 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.199964    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wz5cz\" (UniqueName: \"kubernetes.io/projected/2b7dadd0-0ba9-487a-8b53-4a292313353b-kube-api-access-wz5cz\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:05.199995 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.199993    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b7dadd0-0ba9-487a-8b53-4a292313353b-oauth-serving-cert\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:05.200138 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.200008    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b7dadd0-0ba9-487a-8b53-4a292313353b-service-ca\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:05.200138 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.200020    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b7dadd0-0ba9-487a-8b53-4a292313353b-console-config\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:05.200138 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.200032    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b7dadd0-0ba9-487a-8b53-4a292313353b-console-oauth-config\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:05.200138 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.200043    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b7dadd0-0ba9-487a-8b53-4a292313353b-console-serving-cert\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:05.818910 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.818874    2556 generic.go:356] "Generic (PLEG): container finished" podID="2b7dadd0-0ba9-487a-8b53-4a292313353b" containerID="0ebb55b62a79ec9c9370287b3a8adc4ff8e86a11816efddf04dae63673ff372d" exitCode=0
Aug 04 00:04:05.819343 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.818929    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5765dcb8b5-p9hs9"
Aug 04 00:04:05.819343 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.818941    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5765dcb8b5-p9hs9" event={"ID":"2b7dadd0-0ba9-487a-8b53-4a292313353b","Type":"ContainerDied","Data":"0ebb55b62a79ec9c9370287b3a8adc4ff8e86a11816efddf04dae63673ff372d"}
Aug 04 00:04:05.819343 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.819004    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5765dcb8b5-p9hs9" event={"ID":"2b7dadd0-0ba9-487a-8b53-4a292313353b","Type":"ContainerDied","Data":"77f421e37d05ff991f8a18a7771c47a853d1bc46e38b8d6f75109d87ee69226a"}
Aug 04 00:04:05.819343 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.819024    2556 scope.go:117] "RemoveContainer" containerID="0ebb55b62a79ec9c9370287b3a8adc4ff8e86a11816efddf04dae63673ff372d"
Aug 04 00:04:05.834642 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.834621    2556 scope.go:117] "RemoveContainer" containerID="0ebb55b62a79ec9c9370287b3a8adc4ff8e86a11816efddf04dae63673ff372d"
Aug 04 00:04:05.834916 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:04:05.834894    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ebb55b62a79ec9c9370287b3a8adc4ff8e86a11816efddf04dae63673ff372d\": container with ID starting with 0ebb55b62a79ec9c9370287b3a8adc4ff8e86a11816efddf04dae63673ff372d not found: ID does not exist" containerID="0ebb55b62a79ec9c9370287b3a8adc4ff8e86a11816efddf04dae63673ff372d"
Aug 04 00:04:05.834992 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.834922    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ebb55b62a79ec9c9370287b3a8adc4ff8e86a11816efddf04dae63673ff372d"} err="failed to get container status \"0ebb55b62a79ec9c9370287b3a8adc4ff8e86a11816efddf04dae63673ff372d\": rpc error: code = NotFound desc = could not find container \"0ebb55b62a79ec9c9370287b3a8adc4ff8e86a11816efddf04dae63673ff372d\": container with ID starting with 0ebb55b62a79ec9c9370287b3a8adc4ff8e86a11816efddf04dae63673ff372d not found: ID does not exist"
Aug 04 00:04:05.838279 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.838260    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5765dcb8b5-p9hs9"]
Aug 04 00:04:05.840664 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:05.840640    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5765dcb8b5-p9hs9"]
Aug 04 00:04:06.306537 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:06.306507    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b7dadd0-0ba9-487a-8b53-4a292313353b" path="/var/lib/kubelet/pods/2b7dadd0-0ba9-487a-8b53-4a292313353b/volumes"
Aug 04 00:04:08.709550 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:08.709510    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xqvmz"
Aug 04 00:04:28.887688 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:28.887649    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:28.906338 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:28.906313    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:28.924457 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:28.924434    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:42.578912 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:42.578873    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 00:04:42.579493 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:42.579259    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="alertmanager" containerID="cri-o://0a58962c2513a55312e627da1d0ea505f03c3a195620d1c1b6fe39c1b18b8bdd" gracePeriod=120
Aug 04 00:04:42.579493 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:42.579338    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="kube-rbac-proxy-metric" containerID="cri-o://5495419370b83dad337b4e58c58ed7f645f1c2588a6349b33153a562d6817b4c" gracePeriod=120
Aug 04 00:04:42.579493 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:42.579362    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="kube-rbac-proxy-web" containerID="cri-o://d3401ea2b477e7b90f4d7a5f53ea9e5e3800765bb80b123348c86635607e4ec8" gracePeriod=120
Aug 04 00:04:42.579493 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:42.579394    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="kube-rbac-proxy" containerID="cri-o://2e09b61782cc6ed2b4f22fdd50096956b26d6b724a6660200ab3560be7dc524d" gracePeriod=120
Aug 04 00:04:42.579493 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:42.579441    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="config-reloader" containerID="cri-o://996d8dd7e213a937e2c39f23e56bcbd5313c186436412ed43df9021376519606" gracePeriod=120
Aug 04 00:04:42.579493 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:42.579347    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="prom-label-proxy" containerID="cri-o://fc6144e431ac3645dd25a2f67117213cf0458c77f311d5f0d31feee66f5b6fa0" gracePeriod=120
Aug 04 00:04:42.975671 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:42.975216    2556 generic.go:356] "Generic (PLEG): container finished" podID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerID="fc6144e431ac3645dd25a2f67117213cf0458c77f311d5f0d31feee66f5b6fa0" exitCode=0
Aug 04 00:04:42.975671 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:42.975247    2556 generic.go:356] "Generic (PLEG): container finished" podID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerID="5495419370b83dad337b4e58c58ed7f645f1c2588a6349b33153a562d6817b4c" exitCode=0
Aug 04 00:04:42.975671 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:42.975259    2556 generic.go:356] "Generic (PLEG): container finished" podID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerID="2e09b61782cc6ed2b4f22fdd50096956b26d6b724a6660200ab3560be7dc524d" exitCode=0
Aug 04 00:04:42.975671 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:42.975269    2556 generic.go:356] "Generic (PLEG): container finished" podID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerID="996d8dd7e213a937e2c39f23e56bcbd5313c186436412ed43df9021376519606" exitCode=0
Aug 04 00:04:42.975671 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:42.975279    2556 generic.go:356] "Generic (PLEG): container finished" podID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerID="0a58962c2513a55312e627da1d0ea505f03c3a195620d1c1b6fe39c1b18b8bdd" exitCode=0
Aug 04 00:04:42.975671 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:42.975313    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1437e594-4eae-42ee-9097-2e6c0a37132e","Type":"ContainerDied","Data":"fc6144e431ac3645dd25a2f67117213cf0458c77f311d5f0d31feee66f5b6fa0"}
Aug 04 00:04:42.975671 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:42.975389    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1437e594-4eae-42ee-9097-2e6c0a37132e","Type":"ContainerDied","Data":"5495419370b83dad337b4e58c58ed7f645f1c2588a6349b33153a562d6817b4c"}
Aug 04 00:04:42.975671 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:42.975438    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1437e594-4eae-42ee-9097-2e6c0a37132e","Type":"ContainerDied","Data":"2e09b61782cc6ed2b4f22fdd50096956b26d6b724a6660200ab3560be7dc524d"}
Aug 04 00:04:42.975671 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:42.975482    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1437e594-4eae-42ee-9097-2e6c0a37132e","Type":"ContainerDied","Data":"996d8dd7e213a937e2c39f23e56bcbd5313c186436412ed43df9021376519606"}
Aug 04 00:04:42.975671 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:42.975526    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1437e594-4eae-42ee-9097-2e6c0a37132e","Type":"ContainerDied","Data":"0a58962c2513a55312e627da1d0ea505f03c3a195620d1c1b6fe39c1b18b8bdd"}
Aug 04 00:04:43.824814 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.824787    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:43.946032 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.945938    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1437e594-4eae-42ee-9097-2e6c0a37132e-metrics-client-ca\") pod \"1437e594-4eae-42ee-9097-2e6c0a37132e\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") "
Aug 04 00:04:43.946032 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.946021    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wft5v\" (UniqueName: \"kubernetes.io/projected/1437e594-4eae-42ee-9097-2e6c0a37132e-kube-api-access-wft5v\") pod \"1437e594-4eae-42ee-9097-2e6c0a37132e\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") "
Aug 04 00:04:43.946233 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.946041    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1437e594-4eae-42ee-9097-2e6c0a37132e-config-out\") pod \"1437e594-4eae-42ee-9097-2e6c0a37132e\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") "
Aug 04 00:04:43.946233 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.946065    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1437e594-4eae-42ee-9097-2e6c0a37132e-tls-assets\") pod \"1437e594-4eae-42ee-9097-2e6c0a37132e\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") "
Aug 04 00:04:43.946233 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.946089    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-config-volume\") pod \"1437e594-4eae-42ee-9097-2e6c0a37132e\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") "
Aug 04 00:04:43.946233 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.946114    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1437e594-4eae-42ee-9097-2e6c0a37132e-alertmanager-main-db\") pod \"1437e594-4eae-42ee-9097-2e6c0a37132e\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") "
Aug 04 00:04:43.946233 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.946167    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-web-config\") pod \"1437e594-4eae-42ee-9097-2e6c0a37132e\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") "
Aug 04 00:04:43.946233 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.946196    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-main-tls\") pod \"1437e594-4eae-42ee-9097-2e6c0a37132e\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") "
Aug 04 00:04:43.946233 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.946224    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-kube-rbac-proxy-web\") pod \"1437e594-4eae-42ee-9097-2e6c0a37132e\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") "
Aug 04 00:04:43.946609 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.946259    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"1437e594-4eae-42ee-9097-2e6c0a37132e\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") "
Aug 04 00:04:43.946609 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.946298    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1437e594-4eae-42ee-9097-2e6c0a37132e-alertmanager-trusted-ca-bundle\") pod \"1437e594-4eae-42ee-9097-2e6c0a37132e\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") "
Aug 04 00:04:43.946609 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.946325    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-cluster-tls-config\") pod \"1437e594-4eae-42ee-9097-2e6c0a37132e\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") "
Aug 04 00:04:43.946609 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.946347    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1437e594-4eae-42ee-9097-2e6c0a37132e-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "1437e594-4eae-42ee-9097-2e6c0a37132e" (UID: "1437e594-4eae-42ee-9097-2e6c0a37132e"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:04:43.946609 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.946361    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-kube-rbac-proxy\") pod \"1437e594-4eae-42ee-9097-2e6c0a37132e\" (UID: \"1437e594-4eae-42ee-9097-2e6c0a37132e\") "
Aug 04 00:04:43.946609 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.946516    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1437e594-4eae-42ee-9097-2e6c0a37132e-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "1437e594-4eae-42ee-9097-2e6c0a37132e" (UID: "1437e594-4eae-42ee-9097-2e6c0a37132e"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:04:43.946937 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.946738    2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1437e594-4eae-42ee-9097-2e6c0a37132e-alertmanager-main-db\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:43.946937 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.946762    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1437e594-4eae-42ee-9097-2e6c0a37132e-metrics-client-ca\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:43.947215 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.947165    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1437e594-4eae-42ee-9097-2e6c0a37132e-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "1437e594-4eae-42ee-9097-2e6c0a37132e" (UID: "1437e594-4eae-42ee-9097-2e6c0a37132e"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:04:43.949482 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.949443    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "1437e594-4eae-42ee-9097-2e6c0a37132e" (UID: "1437e594-4eae-42ee-9097-2e6c0a37132e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:04:43.949931 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.949905    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "1437e594-4eae-42ee-9097-2e6c0a37132e" (UID: "1437e594-4eae-42ee-9097-2e6c0a37132e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:04:43.950077 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.949995    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1437e594-4eae-42ee-9097-2e6c0a37132e-config-out" (OuterVolumeSpecName: "config-out") pod "1437e594-4eae-42ee-9097-2e6c0a37132e" (UID: "1437e594-4eae-42ee-9097-2e6c0a37132e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:04:43.950438 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.950400    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-config-volume" (OuterVolumeSpecName: "config-volume") pod "1437e594-4eae-42ee-9097-2e6c0a37132e" (UID: "1437e594-4eae-42ee-9097-2e6c0a37132e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:04:43.950645 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.950615    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1437e594-4eae-42ee-9097-2e6c0a37132e-kube-api-access-wft5v" (OuterVolumeSpecName: "kube-api-access-wft5v") pod "1437e594-4eae-42ee-9097-2e6c0a37132e" (UID: "1437e594-4eae-42ee-9097-2e6c0a37132e"). InnerVolumeSpecName "kube-api-access-wft5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:04:43.950645 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.950630    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "1437e594-4eae-42ee-9097-2e6c0a37132e" (UID: "1437e594-4eae-42ee-9097-2e6c0a37132e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:04:43.950804 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.950701    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1437e594-4eae-42ee-9097-2e6c0a37132e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1437e594-4eae-42ee-9097-2e6c0a37132e" (UID: "1437e594-4eae-42ee-9097-2e6c0a37132e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:04:43.950804 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.950743    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "1437e594-4eae-42ee-9097-2e6c0a37132e" (UID: "1437e594-4eae-42ee-9097-2e6c0a37132e"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:04:43.954130 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.954105    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "1437e594-4eae-42ee-9097-2e6c0a37132e" (UID: "1437e594-4eae-42ee-9097-2e6c0a37132e"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:04:43.960058 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.960034    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-web-config" (OuterVolumeSpecName: "web-config") pod "1437e594-4eae-42ee-9097-2e6c0a37132e" (UID: "1437e594-4eae-42ee-9097-2e6c0a37132e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:04:43.982356 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.982327    2556 generic.go:356] "Generic (PLEG): container finished" podID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerID="d3401ea2b477e7b90f4d7a5f53ea9e5e3800765bb80b123348c86635607e4ec8" exitCode=0
Aug 04 00:04:43.982482 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.982401    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1437e594-4eae-42ee-9097-2e6c0a37132e","Type":"ContainerDied","Data":"d3401ea2b477e7b90f4d7a5f53ea9e5e3800765bb80b123348c86635607e4ec8"}
Aug 04 00:04:43.982482 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.982419    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:43.982616 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.982501    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1437e594-4eae-42ee-9097-2e6c0a37132e","Type":"ContainerDied","Data":"d49dee9f3c997e7df26ca30b2593cbaee20b9f930e0667677a3d228a19ffb56a"}
Aug 04 00:04:43.982616 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.982534    2556 scope.go:117] "RemoveContainer" containerID="fc6144e431ac3645dd25a2f67117213cf0458c77f311d5f0d31feee66f5b6fa0"
Aug 04 00:04:43.990392 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.990369    2556 scope.go:117] "RemoveContainer" containerID="5495419370b83dad337b4e58c58ed7f645f1c2588a6349b33153a562d6817b4c"
Aug 04 00:04:43.997876 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:43.997858    2556 scope.go:117] "RemoveContainer" containerID="2e09b61782cc6ed2b4f22fdd50096956b26d6b724a6660200ab3560be7dc524d"
Aug 04 00:04:44.005151 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.005063    2556 scope.go:117] "RemoveContainer" containerID="d3401ea2b477e7b90f4d7a5f53ea9e5e3800765bb80b123348c86635607e4ec8"
Aug 04 00:04:44.006663 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.006645    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 00:04:44.010351 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.010327    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 00:04:44.012986 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.012970    2556 scope.go:117] "RemoveContainer" containerID="996d8dd7e213a937e2c39f23e56bcbd5313c186436412ed43df9021376519606"
Aug 04 00:04:44.019686 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.019669    2556 scope.go:117] "RemoveContainer" containerID="0a58962c2513a55312e627da1d0ea505f03c3a195620d1c1b6fe39c1b18b8bdd"
Aug 04 00:04:44.026484 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.026465    2556 scope.go:117] "RemoveContainer" containerID="161a657decc92cae7ef94e6f07ef3bd3442b9efd951d4687d021d5ae610f8b40"
Aug 04 00:04:44.033390 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.033359    2556 scope.go:117] "RemoveContainer" containerID="fc6144e431ac3645dd25a2f67117213cf0458c77f311d5f0d31feee66f5b6fa0"
Aug 04 00:04:44.033650 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:04:44.033623    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc6144e431ac3645dd25a2f67117213cf0458c77f311d5f0d31feee66f5b6fa0\": container with ID starting with fc6144e431ac3645dd25a2f67117213cf0458c77f311d5f0d31feee66f5b6fa0 not found: ID does not exist" containerID="fc6144e431ac3645dd25a2f67117213cf0458c77f311d5f0d31feee66f5b6fa0"
Aug 04 00:04:44.033698 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.033658    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6144e431ac3645dd25a2f67117213cf0458c77f311d5f0d31feee66f5b6fa0"} err="failed to get container status \"fc6144e431ac3645dd25a2f67117213cf0458c77f311d5f0d31feee66f5b6fa0\": rpc error: code = NotFound desc = could not find container \"fc6144e431ac3645dd25a2f67117213cf0458c77f311d5f0d31feee66f5b6fa0\": container with ID starting with fc6144e431ac3645dd25a2f67117213cf0458c77f311d5f0d31feee66f5b6fa0 not found: ID does not exist"
Aug 04 00:04:44.033698 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.033675    2556 scope.go:117] "RemoveContainer" containerID="5495419370b83dad337b4e58c58ed7f645f1c2588a6349b33153a562d6817b4c"
Aug 04 00:04:44.033934 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:04:44.033914    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5495419370b83dad337b4e58c58ed7f645f1c2588a6349b33153a562d6817b4c\": container with ID starting with 5495419370b83dad337b4e58c58ed7f645f1c2588a6349b33153a562d6817b4c not found: ID does not exist" containerID="5495419370b83dad337b4e58c58ed7f645f1c2588a6349b33153a562d6817b4c"
Aug 04 00:04:44.033986 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.033942    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5495419370b83dad337b4e58c58ed7f645f1c2588a6349b33153a562d6817b4c"} err="failed to get container status \"5495419370b83dad337b4e58c58ed7f645f1c2588a6349b33153a562d6817b4c\": rpc error: code = NotFound desc = could not find container \"5495419370b83dad337b4e58c58ed7f645f1c2588a6349b33153a562d6817b4c\": container with ID starting with 5495419370b83dad337b4e58c58ed7f645f1c2588a6349b33153a562d6817b4c not found: ID does not exist"
Aug 04 00:04:44.033986 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.033959    2556 scope.go:117] "RemoveContainer" containerID="2e09b61782cc6ed2b4f22fdd50096956b26d6b724a6660200ab3560be7dc524d"
Aug 04 00:04:44.034230 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:04:44.034203    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e09b61782cc6ed2b4f22fdd50096956b26d6b724a6660200ab3560be7dc524d\": container with ID starting with 2e09b61782cc6ed2b4f22fdd50096956b26d6b724a6660200ab3560be7dc524d not found: ID does not exist" containerID="2e09b61782cc6ed2b4f22fdd50096956b26d6b724a6660200ab3560be7dc524d"
Aug 04 00:04:44.034365 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.034259    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e09b61782cc6ed2b4f22fdd50096956b26d6b724a6660200ab3560be7dc524d"} err="failed to get container status \"2e09b61782cc6ed2b4f22fdd50096956b26d6b724a6660200ab3560be7dc524d\": rpc error: code = NotFound desc = could not find container \"2e09b61782cc6ed2b4f22fdd50096956b26d6b724a6660200ab3560be7dc524d\": container with ID starting with 2e09b61782cc6ed2b4f22fdd50096956b26d6b724a6660200ab3560be7dc524d not found: ID does not exist"
Aug 04 00:04:44.034365 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.034285    2556 scope.go:117] "RemoveContainer" containerID="d3401ea2b477e7b90f4d7a5f53ea9e5e3800765bb80b123348c86635607e4ec8"
Aug 04 00:04:44.034641 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:04:44.034579    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3401ea2b477e7b90f4d7a5f53ea9e5e3800765bb80b123348c86635607e4ec8\": container with ID starting with d3401ea2b477e7b90f4d7a5f53ea9e5e3800765bb80b123348c86635607e4ec8 not found: ID does not exist" containerID="d3401ea2b477e7b90f4d7a5f53ea9e5e3800765bb80b123348c86635607e4ec8"
Aug 04 00:04:44.034641 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.034609    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3401ea2b477e7b90f4d7a5f53ea9e5e3800765bb80b123348c86635607e4ec8"} err="failed to get container status \"d3401ea2b477e7b90f4d7a5f53ea9e5e3800765bb80b123348c86635607e4ec8\": rpc error: code = NotFound desc = could not find container \"d3401ea2b477e7b90f4d7a5f53ea9e5e3800765bb80b123348c86635607e4ec8\": container with ID starting with d3401ea2b477e7b90f4d7a5f53ea9e5e3800765bb80b123348c86635607e4ec8 not found: ID does not exist"
Aug 04 00:04:44.034641 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.034631    2556 scope.go:117] "RemoveContainer" containerID="996d8dd7e213a937e2c39f23e56bcbd5313c186436412ed43df9021376519606"
Aug 04 00:04:44.035196 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:04:44.035168    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"996d8dd7e213a937e2c39f23e56bcbd5313c186436412ed43df9021376519606\": container with ID starting with 996d8dd7e213a937e2c39f23e56bcbd5313c186436412ed43df9021376519606 not found: ID does not exist" containerID="996d8dd7e213a937e2c39f23e56bcbd5313c186436412ed43df9021376519606"
Aug 04 00:04:44.035283 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.035197    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"996d8dd7e213a937e2c39f23e56bcbd5313c186436412ed43df9021376519606"} err="failed to get container status \"996d8dd7e213a937e2c39f23e56bcbd5313c186436412ed43df9021376519606\": rpc error: code = NotFound desc = could not find container \"996d8dd7e213a937e2c39f23e56bcbd5313c186436412ed43df9021376519606\": container with ID starting with 996d8dd7e213a937e2c39f23e56bcbd5313c186436412ed43df9021376519606 not found: ID does not exist"
Aug 04 00:04:44.035283 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.035219    2556 scope.go:117] "RemoveContainer" containerID="0a58962c2513a55312e627da1d0ea505f03c3a195620d1c1b6fe39c1b18b8bdd"
Aug 04 00:04:44.035528 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:04:44.035506    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a58962c2513a55312e627da1d0ea505f03c3a195620d1c1b6fe39c1b18b8bdd\": container with ID starting with 0a58962c2513a55312e627da1d0ea505f03c3a195620d1c1b6fe39c1b18b8bdd not found: ID does not exist" containerID="0a58962c2513a55312e627da1d0ea505f03c3a195620d1c1b6fe39c1b18b8bdd"
Aug 04 00:04:44.035577 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.035536    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a58962c2513a55312e627da1d0ea505f03c3a195620d1c1b6fe39c1b18b8bdd"} err="failed to get container status \"0a58962c2513a55312e627da1d0ea505f03c3a195620d1c1b6fe39c1b18b8bdd\": rpc error: code = NotFound desc = could not find container \"0a58962c2513a55312e627da1d0ea505f03c3a195620d1c1b6fe39c1b18b8bdd\": container with ID starting with 0a58962c2513a55312e627da1d0ea505f03c3a195620d1c1b6fe39c1b18b8bdd not found: ID does not exist"
Aug 04 00:04:44.035577 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.035552    2556 scope.go:117] "RemoveContainer" containerID="161a657decc92cae7ef94e6f07ef3bd3442b9efd951d4687d021d5ae610f8b40"
Aug 04 00:04:44.035834 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:04:44.035815    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"161a657decc92cae7ef94e6f07ef3bd3442b9efd951d4687d021d5ae610f8b40\": container with ID starting with 161a657decc92cae7ef94e6f07ef3bd3442b9efd951d4687d021d5ae610f8b40 not found: ID does not exist" containerID="161a657decc92cae7ef94e6f07ef3bd3442b9efd951d4687d021d5ae610f8b40"
Aug 04 00:04:44.035914 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.035841    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"161a657decc92cae7ef94e6f07ef3bd3442b9efd951d4687d021d5ae610f8b40"} err="failed to get container status \"161a657decc92cae7ef94e6f07ef3bd3442b9efd951d4687d021d5ae610f8b40\": rpc error: code = NotFound desc = could not find container \"161a657decc92cae7ef94e6f07ef3bd3442b9efd951d4687d021d5ae610f8b40\": container with ID starting with 161a657decc92cae7ef94e6f07ef3bd3442b9efd951d4687d021d5ae610f8b40 not found: ID does not exist"
Aug 04 00:04:44.036230 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.036215    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 00:04:44.036514 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.036503    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="kube-rbac-proxy"
Aug 04 00:04:44.036551 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.036517    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="kube-rbac-proxy"
Aug 04 00:04:44.036551 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.036525    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="prom-label-proxy"
Aug 04 00:04:44.036551 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.036531    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="prom-label-proxy"
Aug 04 00:04:44.036551 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.036539    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="alertmanager"
Aug 04 00:04:44.036551 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.036545    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="alertmanager"
Aug 04 00:04:44.036686 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.036555    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="init-config-reloader"
Aug 04 00:04:44.036686 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.036561    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="init-config-reloader"
Aug 04 00:04:44.036686 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.036568    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b7dadd0-0ba9-487a-8b53-4a292313353b" containerName="console"
Aug 04 00:04:44.036686 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.036573    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b7dadd0-0ba9-487a-8b53-4a292313353b" containerName="console"
Aug 04 00:04:44.036686 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.036578    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="kube-rbac-proxy-metric"
Aug 04 00:04:44.036686 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.036583    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="kube-rbac-proxy-metric"
Aug 04 00:04:44.036686 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.036591    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="config-reloader"
Aug 04 00:04:44.036686 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.036595    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="config-reloader"
Aug 04 00:04:44.036686 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.036604    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="kube-rbac-proxy-web"
Aug 04 00:04:44.036686 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.036609    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="kube-rbac-proxy-web"
Aug 04 00:04:44.036686 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.036649    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b7dadd0-0ba9-487a-8b53-4a292313353b" containerName="console"
Aug 04 00:04:44.036686 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.036656    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="alertmanager"
Aug 04 00:04:44.036686 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.036663    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="config-reloader"
Aug 04 00:04:44.036686 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.036668    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="prom-label-proxy"
Aug 04 00:04:44.036686 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.036674    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="kube-rbac-proxy"
Aug 04 00:04:44.036686 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.036682    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="kube-rbac-proxy-web"
Aug 04 00:04:44.036686 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.036687    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" containerName="kube-rbac-proxy-metric"
Aug 04 00:04:44.039268 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.039253    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.041844 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.041823    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Aug 04 00:04:44.041952 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.041933    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Aug 04 00:04:44.042019 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.041991    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Aug 04 00:04:44.042019 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.042008    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Aug 04 00:04:44.042140 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.042122    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Aug 04 00:04:44.042196 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.042176    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Aug 04 00:04:44.042296 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.042257    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Aug 04 00:04:44.042296 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.042294    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lv5q2\""
Aug 04 00:04:44.042475 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.042382    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Aug 04 00:04:44.047233 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.047214    2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1437e594-4eae-42ee-9097-2e6c0a37132e-tls-assets\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:44.047313 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.047241    2556 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-config-volume\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:44.047313 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.047255    2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-web-config\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:44.047313 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.047267    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-main-tls\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:44.047313 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.047297    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:44.047467 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.047314    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:44.047467 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.047328    2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1437e594-4eae-42ee-9097-2e6c0a37132e-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:44.047467 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.047343    2556 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-cluster-tls-config\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:44.047467 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.047357    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1437e594-4eae-42ee-9097-2e6c0a37132e-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:44.047467 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.047370    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wft5v\" (UniqueName: \"kubernetes.io/projected/1437e594-4eae-42ee-9097-2e6c0a37132e-kube-api-access-wft5v\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:44.047467 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.047384    2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1437e594-4eae-42ee-9097-2e6c0a37132e-config-out\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:44.048219 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.048204    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Aug 04 00:04:44.052826 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.052806    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 00:04:44.147779 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.147737    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e174b9d6-5792-451a-8fc7-47d36c452421-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.147779 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.147781    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e174b9d6-5792-451a-8fc7-47d36c452421-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.148036 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.147824    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e174b9d6-5792-451a-8fc7-47d36c452421-web-config\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.148036 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.147839    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e174b9d6-5792-451a-8fc7-47d36c452421-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.148036 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.147860    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e174b9d6-5792-451a-8fc7-47d36c452421-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.148036 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.147876    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e174b9d6-5792-451a-8fc7-47d36c452421-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.148036 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.147940    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e174b9d6-5792-451a-8fc7-47d36c452421-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.148036 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.147995    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e174b9d6-5792-451a-8fc7-47d36c452421-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.148036 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.148030    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn79r\" (UniqueName: \"kubernetes.io/projected/e174b9d6-5792-451a-8fc7-47d36c452421-kube-api-access-zn79r\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.148330 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.148067    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e174b9d6-5792-451a-8fc7-47d36c452421-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.148330 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.148104    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e174b9d6-5792-451a-8fc7-47d36c452421-config-out\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.148330 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.148140    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e174b9d6-5792-451a-8fc7-47d36c452421-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.148330 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.148174    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e174b9d6-5792-451a-8fc7-47d36c452421-config-volume\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.249178 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.249092    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e174b9d6-5792-451a-8fc7-47d36c452421-config-out\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.249178 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.249135    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e174b9d6-5792-451a-8fc7-47d36c452421-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.249178 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.249159    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e174b9d6-5792-451a-8fc7-47d36c452421-config-volume\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.249452 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.249271    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e174b9d6-5792-451a-8fc7-47d36c452421-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.249452 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.249313    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e174b9d6-5792-451a-8fc7-47d36c452421-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.249452 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.249433    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e174b9d6-5792-451a-8fc7-47d36c452421-web-config\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.249620 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.249469    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e174b9d6-5792-451a-8fc7-47d36c452421-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.249620 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.249509    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e174b9d6-5792-451a-8fc7-47d36c452421-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.249620 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.249533    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e174b9d6-5792-451a-8fc7-47d36c452421-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.249620 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.249577    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e174b9d6-5792-451a-8fc7-47d36c452421-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.249837 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.249629    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e174b9d6-5792-451a-8fc7-47d36c452421-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.249837 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.249662    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn79r\" (UniqueName: \"kubernetes.io/projected/e174b9d6-5792-451a-8fc7-47d36c452421-kube-api-access-zn79r\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.249837 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.249704    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e174b9d6-5792-451a-8fc7-47d36c452421-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.250508 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.250480    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e174b9d6-5792-451a-8fc7-47d36c452421-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.250776 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.250748    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e174b9d6-5792-451a-8fc7-47d36c452421-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.252352 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.251860    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e174b9d6-5792-451a-8fc7-47d36c452421-config-out\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.252352 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.252038    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e174b9d6-5792-451a-8fc7-47d36c452421-config-volume\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.252352 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.252146    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e174b9d6-5792-451a-8fc7-47d36c452421-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.252352 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.252315    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e174b9d6-5792-451a-8fc7-47d36c452421-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.252352 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.252325    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e174b9d6-5792-451a-8fc7-47d36c452421-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.252658 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.252593    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e174b9d6-5792-451a-8fc7-47d36c452421-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.252793 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.252777    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e174b9d6-5792-451a-8fc7-47d36c452421-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.253288 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.253262    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e174b9d6-5792-451a-8fc7-47d36c452421-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.253356 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.253328    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e174b9d6-5792-451a-8fc7-47d36c452421-web-config\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.253953 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.253937    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e174b9d6-5792-451a-8fc7-47d36c452421-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.259882 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.259864    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn79r\" (UniqueName: \"kubernetes.io/projected/e174b9d6-5792-451a-8fc7-47d36c452421-kube-api-access-zn79r\") pod \"alertmanager-main-0\" (UID: \"e174b9d6-5792-451a-8fc7-47d36c452421\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.307101 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.307068    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1437e594-4eae-42ee-9097-2e6c0a37132e" path="/var/lib/kubelet/pods/1437e594-4eae-42ee-9097-2e6c0a37132e/volumes"
Aug 04 00:04:44.349405 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.349372    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 00:04:44.484084 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.484060    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 00:04:44.485864 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:04:44.485841    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode174b9d6_5792_451a_8fc7_47d36c452421.slice/crio-9e673d275b5f2ed709e1e85a077a7852d4a83b4179733e3482d888d33a74b861 WatchSource:0}: Error finding container 9e673d275b5f2ed709e1e85a077a7852d4a83b4179733e3482d888d33a74b861: Status 404 returned error can't find the container with id 9e673d275b5f2ed709e1e85a077a7852d4a83b4179733e3482d888d33a74b861
Aug 04 00:04:44.988775 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.988738    2556 generic.go:356] "Generic (PLEG): container finished" podID="e174b9d6-5792-451a-8fc7-47d36c452421" containerID="9e1a30b516c775fa322a14ee8583b83c218e293a9868e11820c88b959b0def49" exitCode=0
Aug 04 00:04:44.989214 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.988816    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e174b9d6-5792-451a-8fc7-47d36c452421","Type":"ContainerDied","Data":"9e1a30b516c775fa322a14ee8583b83c218e293a9868e11820c88b959b0def49"}
Aug 04 00:04:44.989214 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:44.988894    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e174b9d6-5792-451a-8fc7-47d36c452421","Type":"ContainerStarted","Data":"9e673d275b5f2ed709e1e85a077a7852d4a83b4179733e3482d888d33a74b861"}
Aug 04 00:04:45.997196 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:45.997159    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e174b9d6-5792-451a-8fc7-47d36c452421","Type":"ContainerStarted","Data":"910bbd54f96abb6bdeaf6250130eeb886548ab0916af2f7aa5471646ff466e5d"}
Aug 04 00:04:45.997564 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:45.997254    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e174b9d6-5792-451a-8fc7-47d36c452421","Type":"ContainerStarted","Data":"ea199c7fca1252f70b6d5249ca67218b3cc0fcc85e2af4555701ed7ef13fd38f"}
Aug 04 00:04:45.997564 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:45.997282    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e174b9d6-5792-451a-8fc7-47d36c452421","Type":"ContainerStarted","Data":"6adfeb4d64975e0e59391136f23e0dcb63720942717a5fb24eaa49b921dc2d08"}
Aug 04 00:04:45.997564 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:45.997305    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e174b9d6-5792-451a-8fc7-47d36c452421","Type":"ContainerStarted","Data":"0211af1198d9ba57a7c47497bad10d01c425f2182f3aecf32a8184d12e326d28"}
Aug 04 00:04:45.997564 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:45.997332    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e174b9d6-5792-451a-8fc7-47d36c452421","Type":"ContainerStarted","Data":"ac4847d8d35842f47c27239be5dc5dc4afa5d82452fa714e02d2c4014dcab1f6"}
Aug 04 00:04:45.997564 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:45.997360    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e174b9d6-5792-451a-8fc7-47d36c452421","Type":"ContainerStarted","Data":"5936d46a27e71a8b80264c0774092411eca4ae7caf6ad7b05eb5d0fa5472f861"}
Aug 04 00:04:46.023066 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.023007    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.008533712 podStartE2EDuration="2.02298657s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.452858ms" isStatefulPod=false podCreationTimestamp="2026-08-04 00:04:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:04:46.020079026 +0000 UTC m=+140.188716395" watchObservedRunningTime="2026-08-04 00:04:46.02298657 +0000 UTC m=+140.191623941"
Aug 04 00:04:46.604581 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.604546    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-9685c57b4-b9w68"]
Aug 04 00:04:46.607053 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.607027    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.610263 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.610239    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-chdq6\""
Aug 04 00:04:46.610383 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.610338    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Aug 04 00:04:46.610683 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.610658    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Aug 04 00:04:46.610835 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.610817    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Aug 04 00:04:46.610916 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.610818    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Aug 04 00:04:46.614739 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.611517    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Aug 04 00:04:46.616616 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.616588    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Aug 04 00:04:46.620002 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.619982    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-9685c57b4-b9w68"]
Aug 04 00:04:46.672584 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.672548    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e190f3cd-55a0-4492-ac8e-98c08d9e514d-telemeter-client-tls\") pod \"telemeter-client-9685c57b4-b9w68\" (UID: \"e190f3cd-55a0-4492-ac8e-98c08d9e514d\") " pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.672795 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.672587    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbss9\" (UniqueName: \"kubernetes.io/projected/e190f3cd-55a0-4492-ac8e-98c08d9e514d-kube-api-access-vbss9\") pod \"telemeter-client-9685c57b4-b9w68\" (UID: \"e190f3cd-55a0-4492-ac8e-98c08d9e514d\") " pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.672795 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.672634    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e190f3cd-55a0-4492-ac8e-98c08d9e514d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9685c57b4-b9w68\" (UID: \"e190f3cd-55a0-4492-ac8e-98c08d9e514d\") " pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.672795 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.672657    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e190f3cd-55a0-4492-ac8e-98c08d9e514d-metrics-client-ca\") pod \"telemeter-client-9685c57b4-b9w68\" (UID: \"e190f3cd-55a0-4492-ac8e-98c08d9e514d\") " pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.672795 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.672757    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e190f3cd-55a0-4492-ac8e-98c08d9e514d-secret-telemeter-client\") pod \"telemeter-client-9685c57b4-b9w68\" (UID: \"e190f3cd-55a0-4492-ac8e-98c08d9e514d\") " pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.672795 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.672784    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e190f3cd-55a0-4492-ac8e-98c08d9e514d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9685c57b4-b9w68\" (UID: \"e190f3cd-55a0-4492-ac8e-98c08d9e514d\") " pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.672998 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.672822    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e190f3cd-55a0-4492-ac8e-98c08d9e514d-serving-certs-ca-bundle\") pod \"telemeter-client-9685c57b4-b9w68\" (UID: \"e190f3cd-55a0-4492-ac8e-98c08d9e514d\") " pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.672998 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.672895    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e190f3cd-55a0-4492-ac8e-98c08d9e514d-federate-client-tls\") pod \"telemeter-client-9685c57b4-b9w68\" (UID: \"e190f3cd-55a0-4492-ac8e-98c08d9e514d\") " pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.773763 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.773698    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e190f3cd-55a0-4492-ac8e-98c08d9e514d-serving-certs-ca-bundle\") pod \"telemeter-client-9685c57b4-b9w68\" (UID: \"e190f3cd-55a0-4492-ac8e-98c08d9e514d\") " pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.773941 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.773786    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e190f3cd-55a0-4492-ac8e-98c08d9e514d-federate-client-tls\") pod \"telemeter-client-9685c57b4-b9w68\" (UID: \"e190f3cd-55a0-4492-ac8e-98c08d9e514d\") " pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.773941 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.773828    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e190f3cd-55a0-4492-ac8e-98c08d9e514d-telemeter-client-tls\") pod \"telemeter-client-9685c57b4-b9w68\" (UID: \"e190f3cd-55a0-4492-ac8e-98c08d9e514d\") " pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.773941 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.773850    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbss9\" (UniqueName: \"kubernetes.io/projected/e190f3cd-55a0-4492-ac8e-98c08d9e514d-kube-api-access-vbss9\") pod \"telemeter-client-9685c57b4-b9w68\" (UID: \"e190f3cd-55a0-4492-ac8e-98c08d9e514d\") " pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.773941 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.773893    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e190f3cd-55a0-4492-ac8e-98c08d9e514d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9685c57b4-b9w68\" (UID: \"e190f3cd-55a0-4492-ac8e-98c08d9e514d\") " pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.773941 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.773916    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e190f3cd-55a0-4492-ac8e-98c08d9e514d-metrics-client-ca\") pod \"telemeter-client-9685c57b4-b9w68\" (UID: \"e190f3cd-55a0-4492-ac8e-98c08d9e514d\") " pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.774201 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.773976    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e190f3cd-55a0-4492-ac8e-98c08d9e514d-secret-telemeter-client\") pod \"telemeter-client-9685c57b4-b9w68\" (UID: \"e190f3cd-55a0-4492-ac8e-98c08d9e514d\") " pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.774201 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.774002    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e190f3cd-55a0-4492-ac8e-98c08d9e514d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9685c57b4-b9w68\" (UID: \"e190f3cd-55a0-4492-ac8e-98c08d9e514d\") " pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.774390 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.774363    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e190f3cd-55a0-4492-ac8e-98c08d9e514d-serving-certs-ca-bundle\") pod \"telemeter-client-9685c57b4-b9w68\" (UID: \"e190f3cd-55a0-4492-ac8e-98c08d9e514d\") " pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.774799 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.774774    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e190f3cd-55a0-4492-ac8e-98c08d9e514d-metrics-client-ca\") pod \"telemeter-client-9685c57b4-b9w68\" (UID: \"e190f3cd-55a0-4492-ac8e-98c08d9e514d\") " pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.775065 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.775043    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e190f3cd-55a0-4492-ac8e-98c08d9e514d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9685c57b4-b9w68\" (UID: \"e190f3cd-55a0-4492-ac8e-98c08d9e514d\") " pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.776880 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.776422    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e190f3cd-55a0-4492-ac8e-98c08d9e514d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9685c57b4-b9w68\" (UID: \"e190f3cd-55a0-4492-ac8e-98c08d9e514d\") " pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.776880 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.776825    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e190f3cd-55a0-4492-ac8e-98c08d9e514d-secret-telemeter-client\") pod \"telemeter-client-9685c57b4-b9w68\" (UID: \"e190f3cd-55a0-4492-ac8e-98c08d9e514d\") " pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.776880 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.776841    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e190f3cd-55a0-4492-ac8e-98c08d9e514d-telemeter-client-tls\") pod \"telemeter-client-9685c57b4-b9w68\" (UID: \"e190f3cd-55a0-4492-ac8e-98c08d9e514d\") " pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.777091 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.776913    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e190f3cd-55a0-4492-ac8e-98c08d9e514d-federate-client-tls\") pod \"telemeter-client-9685c57b4-b9w68\" (UID: \"e190f3cd-55a0-4492-ac8e-98c08d9e514d\") " pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.781243 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.781220    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbss9\" (UniqueName: \"kubernetes.io/projected/e190f3cd-55a0-4492-ac8e-98c08d9e514d-kube-api-access-vbss9\") pod \"telemeter-client-9685c57b4-b9w68\" (UID: \"e190f3cd-55a0-4492-ac8e-98c08d9e514d\") " pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:46.897007 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.896913    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 00:04:46.897473 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.897290    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="prometheus" containerID="cri-o://54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16" gracePeriod=600
Aug 04 00:04:46.897473 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.897309    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="kube-rbac-proxy-thanos" containerID="cri-o://2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080" gracePeriod=600
Aug 04 00:04:46.897473 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.897334    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="kube-rbac-proxy-web" containerID="cri-o://e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e" gracePeriod=600
Aug 04 00:04:46.897473 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.897356    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="config-reloader" containerID="cri-o://269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b" gracePeriod=600
Aug 04 00:04:46.897473 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.897422    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="thanos-sidecar" containerID="cri-o://4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93" gracePeriod=600
Aug 04 00:04:46.897473 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.897355    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="kube-rbac-proxy" containerID="cri-o://1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5" gracePeriod=600
Aug 04 00:04:46.922324 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:46.922299    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68"
Aug 04 00:04:47.081608 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.081585    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-9685c57b4-b9w68"]
Aug 04 00:04:47.083613 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:04:47.083580    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode190f3cd_55a0_4492_ac8e_98c08d9e514d.slice/crio-5a518b4e5946113fcca3904c322a1ca211d1bf35d70f1ab011f57d46e1f3e8a2 WatchSource:0}: Error finding container 5a518b4e5946113fcca3904c322a1ca211d1bf35d70f1ab011f57d46e1f3e8a2: Status 404 returned error can't find the container with id 5a518b4e5946113fcca3904c322a1ca211d1bf35d70f1ab011f57d46e1f3e8a2
Aug 04 00:04:47.164393 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.164370    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:47.278309 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.278275    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcczr\" (UniqueName: \"kubernetes.io/projected/6289e73d-ceb9-453b-9bf4-c35aba2f744c-kube-api-access-lcczr\") pod \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") "
Aug 04 00:04:47.278309 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.278314    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-prometheus-k8s-tls\") pod \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") "
Aug 04 00:04:47.278559 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.278343    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-k8s-rulefiles-0\") pod \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") "
Aug 04 00:04:47.278559 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.278361    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-k8s-db\") pod \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") "
Aug 04 00:04:47.278559 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.278378    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-web-config\") pod \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") "
Aug 04 00:04:47.278559 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.278503    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-kube-rbac-proxy\") pod \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") "
Aug 04 00:04:47.278559 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.278538    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-configmap-kubelet-serving-ca-bundle\") pod \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") "
Aug 04 00:04:47.278849 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.278572    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-k8s-rulefiles-2\") pod \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") "
Aug 04 00:04:47.278849 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.278631    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-metrics-client-certs\") pod \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") "
Aug 04 00:04:47.278849 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.278669    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-trusted-ca-bundle\") pod \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") "
Aug 04 00:04:47.278849 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.278705    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-grpc-tls\") pod \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") "
Aug 04 00:04:47.278849 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.278754    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") "
Aug 04 00:04:47.278849 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.278788    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") "
Aug 04 00:04:47.278849 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.278820    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-thanos-prometheus-http-client-file\") pod \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") "
Aug 04 00:04:47.279179 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.278868    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6289e73d-ceb9-453b-9bf4-c35aba2f744c-tls-assets\") pod \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") "
Aug 04 00:04:47.279179 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.278901    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-config\") pod \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") "
Aug 04 00:04:47.279179 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.278939    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6289e73d-ceb9-453b-9bf4-c35aba2f744c-config-out\") pod \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") "
Aug 04 00:04:47.279179 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.278971    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-k8s-rulefiles-1\") pod \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") "
Aug 04 00:04:47.279179 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.278996    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-configmap-metrics-client-ca\") pod \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") "
Aug 04 00:04:47.279179 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.279020    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-configmap-serving-certs-ca-bundle\") pod \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\" (UID: \"6289e73d-ceb9-453b-9bf4-c35aba2f744c\") "
Aug 04 00:04:47.279471 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.279397    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "6289e73d-ceb9-453b-9bf4-c35aba2f744c" (UID: "6289e73d-ceb9-453b-9bf4-c35aba2f744c"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:04:47.280353 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.279565    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "6289e73d-ceb9-453b-9bf4-c35aba2f744c" (UID: "6289e73d-ceb9-453b-9bf4-c35aba2f744c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:04:47.281777 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.280680    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "6289e73d-ceb9-453b-9bf4-c35aba2f744c" (UID: "6289e73d-ceb9-453b-9bf4-c35aba2f744c"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:04:47.281777 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.280819    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "6289e73d-ceb9-453b-9bf4-c35aba2f744c" (UID: "6289e73d-ceb9-453b-9bf4-c35aba2f744c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:04:47.281777 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.281176    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "6289e73d-ceb9-453b-9bf4-c35aba2f744c" (UID: "6289e73d-ceb9-453b-9bf4-c35aba2f744c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:04:47.281777 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.281536    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "6289e73d-ceb9-453b-9bf4-c35aba2f744c" (UID: "6289e73d-ceb9-453b-9bf4-c35aba2f744c"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:04:47.281777 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.281747    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "6289e73d-ceb9-453b-9bf4-c35aba2f744c" (UID: "6289e73d-ceb9-453b-9bf4-c35aba2f744c"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:04:47.282297 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.282262    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "6289e73d-ceb9-453b-9bf4-c35aba2f744c" (UID: "6289e73d-ceb9-453b-9bf4-c35aba2f744c"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:04:47.282730 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.282666    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6289e73d-ceb9-453b-9bf4-c35aba2f744c-kube-api-access-lcczr" (OuterVolumeSpecName: "kube-api-access-lcczr") pod "6289e73d-ceb9-453b-9bf4-c35aba2f744c" (UID: "6289e73d-ceb9-453b-9bf4-c35aba2f744c"). InnerVolumeSpecName "kube-api-access-lcczr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:04:47.282896 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.282653    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "6289e73d-ceb9-453b-9bf4-c35aba2f744c" (UID: "6289e73d-ceb9-453b-9bf4-c35aba2f744c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:04:47.282959 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.282934    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "6289e73d-ceb9-453b-9bf4-c35aba2f744c" (UID: "6289e73d-ceb9-453b-9bf4-c35aba2f744c"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:04:47.283211 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.283184    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6289e73d-ceb9-453b-9bf4-c35aba2f744c-config-out" (OuterVolumeSpecName: "config-out") pod "6289e73d-ceb9-453b-9bf4-c35aba2f744c" (UID: "6289e73d-ceb9-453b-9bf4-c35aba2f744c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:04:47.283321 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.283209    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "6289e73d-ceb9-453b-9bf4-c35aba2f744c" (UID: "6289e73d-ceb9-453b-9bf4-c35aba2f744c"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:04:47.283321 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.283264    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "6289e73d-ceb9-453b-9bf4-c35aba2f744c" (UID: "6289e73d-ceb9-453b-9bf4-c35aba2f744c"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:04:47.283436 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.283335    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-config" (OuterVolumeSpecName: "config") pod "6289e73d-ceb9-453b-9bf4-c35aba2f744c" (UID: "6289e73d-ceb9-453b-9bf4-c35aba2f744c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:04:47.283682 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.283657    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "6289e73d-ceb9-453b-9bf4-c35aba2f744c" (UID: "6289e73d-ceb9-453b-9bf4-c35aba2f744c"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:04:47.284050 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.284021    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "6289e73d-ceb9-453b-9bf4-c35aba2f744c" (UID: "6289e73d-ceb9-453b-9bf4-c35aba2f744c"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:04:47.284409 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.284389    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6289e73d-ceb9-453b-9bf4-c35aba2f744c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6289e73d-ceb9-453b-9bf4-c35aba2f744c" (UID: "6289e73d-ceb9-453b-9bf4-c35aba2f744c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:04:47.284544 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.284531    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "6289e73d-ceb9-453b-9bf4-c35aba2f744c" (UID: "6289e73d-ceb9-453b-9bf4-c35aba2f744c"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:04:47.292781 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.292754    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-web-config" (OuterVolumeSpecName: "web-config") pod "6289e73d-ceb9-453b-9bf4-c35aba2f744c" (UID: "6289e73d-ceb9-453b-9bf4-c35aba2f744c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:04:47.379947 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.379912    2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:47.379947 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.379939    2556 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:47.379947 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.379948    2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6289e73d-ceb9-453b-9bf4-c35aba2f744c-tls-assets\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:47.379947 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.379958    2556 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-config\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:47.380248 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.379966    2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6289e73d-ceb9-453b-9bf4-c35aba2f744c-config-out\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:47.380248 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.379975    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:47.380248 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.379987    2556 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-configmap-metrics-client-ca\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:47.380248 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.380000    2556 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:47.380248 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.380013    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcczr\" (UniqueName: \"kubernetes.io/projected/6289e73d-ceb9-453b-9bf4-c35aba2f744c-kube-api-access-lcczr\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:47.380248 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.380022    2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:47.380248 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.380030    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:47.380248 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.380038    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-k8s-db\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:47.380248 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.380046    2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-web-config\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:47.380248 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.380054    2556 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-kube-rbac-proxy\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:47.380248 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.380062    2556 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:47.380248 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.380070    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:47.380248 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.380078    2556 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-metrics-client-certs\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:47.380248 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.380088    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6289e73d-ceb9-453b-9bf4-c35aba2f744c-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:47.380248 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.380096    2556 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-grpc-tls\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:47.380248 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:47.380104    2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6289e73d-ceb9-453b-9bf4-c35aba2f744c-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:04:48.012390 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.012342    2556 generic.go:356] "Generic (PLEG): container finished" podID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerID="2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080" exitCode=0
Aug 04 00:04:48.012390 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.012374    2556 generic.go:356] "Generic (PLEG): container finished" podID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerID="1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5" exitCode=0
Aug 04 00:04:48.012390 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.012384    2556 generic.go:356] "Generic (PLEG): container finished" podID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerID="e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e" exitCode=0
Aug 04 00:04:48.012390 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.012393    2556 generic.go:356] "Generic (PLEG): container finished" podID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerID="4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93" exitCode=0
Aug 04 00:04:48.012390 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.012401    2556 generic.go:356] "Generic (PLEG): container finished" podID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerID="269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b" exitCode=0
Aug 04 00:04:48.012782 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.012410    2556 generic.go:356] "Generic (PLEG): container finished" podID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerID="54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16" exitCode=0
Aug 04 00:04:48.012782 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.012449    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.012782 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.012475    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6289e73d-ceb9-453b-9bf4-c35aba2f744c","Type":"ContainerDied","Data":"2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080"}
Aug 04 00:04:48.012782 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.012562    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6289e73d-ceb9-453b-9bf4-c35aba2f744c","Type":"ContainerDied","Data":"1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5"}
Aug 04 00:04:48.012782 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.012607    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6289e73d-ceb9-453b-9bf4-c35aba2f744c","Type":"ContainerDied","Data":"e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e"}
Aug 04 00:04:48.012782 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.012648    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6289e73d-ceb9-453b-9bf4-c35aba2f744c","Type":"ContainerDied","Data":"4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93"}
Aug 04 00:04:48.012782 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.012682    2556 scope.go:117] "RemoveContainer" containerID="2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080"
Aug 04 00:04:48.012782 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.012691    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6289e73d-ceb9-453b-9bf4-c35aba2f744c","Type":"ContainerDied","Data":"269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b"}
Aug 04 00:04:48.012782 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.012753    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6289e73d-ceb9-453b-9bf4-c35aba2f744c","Type":"ContainerDied","Data":"54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16"}
Aug 04 00:04:48.013170 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.012796    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6289e73d-ceb9-453b-9bf4-c35aba2f744c","Type":"ContainerDied","Data":"8953ab393a441e9ec6b4868c258d5fffc09ea666b08dd7cd4c4dd09299a17b55"}
Aug 04 00:04:48.014114 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.014090    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68" event={"ID":"e190f3cd-55a0-4492-ac8e-98c08d9e514d","Type":"ContainerStarted","Data":"5a518b4e5946113fcca3904c322a1ca211d1bf35d70f1ab011f57d46e1f3e8a2"}
Aug 04 00:04:48.022160 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.022025    2556 scope.go:117] "RemoveContainer" containerID="1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5"
Aug 04 00:04:48.032815 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.032794    2556 scope.go:117] "RemoveContainer" containerID="e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e"
Aug 04 00:04:48.039387 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.039334    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 00:04:48.040768 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.040614    2556 scope.go:117] "RemoveContainer" containerID="4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93"
Aug 04 00:04:48.043423 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.043405    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 00:04:48.048061 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.048044    2556 scope.go:117] "RemoveContainer" containerID="269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b"
Aug 04 00:04:48.055505 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.055485    2556 scope.go:117] "RemoveContainer" containerID="54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16"
Aug 04 00:04:48.064547 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.064531    2556 scope.go:117] "RemoveContainer" containerID="b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6"
Aug 04 00:04:48.071301 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.071270    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 00:04:48.071635 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.071617    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="thanos-sidecar"
Aug 04 00:04:48.071724 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.071637    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="thanos-sidecar"
Aug 04 00:04:48.071724 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.071653    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="kube-rbac-proxy-web"
Aug 04 00:04:48.071724 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.071663    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="kube-rbac-proxy-web"
Aug 04 00:04:48.071724 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.071677    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="kube-rbac-proxy"
Aug 04 00:04:48.071724 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.071686    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="kube-rbac-proxy"
Aug 04 00:04:48.071724 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.071697    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="kube-rbac-proxy-thanos"
Aug 04 00:04:48.071724 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.071706    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="kube-rbac-proxy-thanos"
Aug 04 00:04:48.071984 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.071736    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="init-config-reloader"
Aug 04 00:04:48.071984 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.071745    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="init-config-reloader"
Aug 04 00:04:48.071984 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.071757    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="config-reloader"
Aug 04 00:04:48.071984 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.071764    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="config-reloader"
Aug 04 00:04:48.071984 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.071780    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="prometheus"
Aug 04 00:04:48.071984 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.071788    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="prometheus"
Aug 04 00:04:48.071984 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.071862    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="kube-rbac-proxy-web"
Aug 04 00:04:48.071984 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.071870    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="thanos-sidecar"
Aug 04 00:04:48.071984 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.071877    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="config-reloader"
Aug 04 00:04:48.071984 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.071884    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="kube-rbac-proxy"
Aug 04 00:04:48.071984 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.071891    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="prometheus"
Aug 04 00:04:48.071984 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.071900    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" containerName="kube-rbac-proxy-thanos"
Aug 04 00:04:48.073515 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.073496    2556 scope.go:117] "RemoveContainer" containerID="2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080"
Aug 04 00:04:48.073870 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:04:48.073848    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080\": container with ID starting with 2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080 not found: ID does not exist" containerID="2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080"
Aug 04 00:04:48.073957 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.073877    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080"} err="failed to get container status \"2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080\": rpc error: code = NotFound desc = could not find container \"2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080\": container with ID starting with 2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080 not found: ID does not exist"
Aug 04 00:04:48.073957 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.073896    2556 scope.go:117] "RemoveContainer" containerID="1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5"
Aug 04 00:04:48.074247 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:04:48.074230    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5\": container with ID starting with 1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5 not found: ID does not exist" containerID="1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5"
Aug 04 00:04:48.074293 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.074254    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5"} err="failed to get container status \"1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5\": rpc error: code = NotFound desc = could not find container \"1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5\": container with ID starting with 1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5 not found: ID does not exist"
Aug 04 00:04:48.074293 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.074274    2556 scope.go:117] "RemoveContainer" containerID="e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e"
Aug 04 00:04:48.074615 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:04:48.074595    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e\": container with ID starting with e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e not found: ID does not exist" containerID="e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e"
Aug 04 00:04:48.074730 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.074623    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e"} err="failed to get container status \"e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e\": rpc error: code = NotFound desc = could not find container \"e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e\": container with ID starting with e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e not found: ID does not exist"
Aug 04 00:04:48.074730 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.074650    2556 scope.go:117] "RemoveContainer" containerID="4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93"
Aug 04 00:04:48.075056 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:04:48.075023    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93\": container with ID starting with 4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93 not found: ID does not exist" containerID="4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93"
Aug 04 00:04:48.075114 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.075053    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93"} err="failed to get container status \"4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93\": rpc error: code = NotFound desc = could not find container \"4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93\": container with ID starting with 4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93 not found: ID does not exist"
Aug 04 00:04:48.075114 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.075073    2556 scope.go:117] "RemoveContainer" containerID="269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b"
Aug 04 00:04:48.075332 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:04:48.075314    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b\": container with ID starting with 269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b not found: ID does not exist" containerID="269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b"
Aug 04 00:04:48.075395 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.075340    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b"} err="failed to get container status \"269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b\": rpc error: code = NotFound desc = could not find container \"269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b\": container with ID starting with 269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b not found: ID does not exist"
Aug 04 00:04:48.075395 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.075360    2556 scope.go:117] "RemoveContainer" containerID="54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16"
Aug 04 00:04:48.075684 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:04:48.075664    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16\": container with ID starting with 54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16 not found: ID does not exist" containerID="54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16"
Aug 04 00:04:48.075780 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.075691    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16"} err="failed to get container status \"54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16\": rpc error: code = NotFound desc = could not find container \"54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16\": container with ID starting with 54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16 not found: ID does not exist"
Aug 04 00:04:48.075780 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.075727    2556 scope.go:117] "RemoveContainer" containerID="b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6"
Aug 04 00:04:48.075960 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.075940    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.076044 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:04:48.076003    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6\": container with ID starting with b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6 not found: ID does not exist" containerID="b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6"
Aug 04 00:04:48.076044 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.076030    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6"} err="failed to get container status \"b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6\": rpc error: code = NotFound desc = could not find container \"b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6\": container with ID starting with b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6 not found: ID does not exist"
Aug 04 00:04:48.076161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.076051    2556 scope.go:117] "RemoveContainer" containerID="2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080"
Aug 04 00:04:48.076866 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.076837    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080"} err="failed to get container status \"2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080\": rpc error: code = NotFound desc = could not find container \"2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080\": container with ID starting with 2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080 not found: ID does not exist"
Aug 04 00:04:48.076959 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.076867    2556 scope.go:117] "RemoveContainer" containerID="1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5"
Aug 04 00:04:48.077186 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.077154    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5"} err="failed to get container status \"1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5\": rpc error: code = NotFound desc = could not find container \"1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5\": container with ID starting with 1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5 not found: ID does not exist"
Aug 04 00:04:48.077186 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.077185    2556 scope.go:117] "RemoveContainer" containerID="e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e"
Aug 04 00:04:48.077511 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.077484    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e"} err="failed to get container status \"e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e\": rpc error: code = NotFound desc = could not find container \"e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e\": container with ID starting with e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e not found: ID does not exist"
Aug 04 00:04:48.077589 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.077512    2556 scope.go:117] "RemoveContainer" containerID="4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93"
Aug 04 00:04:48.077849 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.077826    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93"} err="failed to get container status \"4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93\": rpc error: code = NotFound desc = could not find container \"4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93\": container with ID starting with 4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93 not found: ID does not exist"
Aug 04 00:04:48.077928 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.077854    2556 scope.go:117] "RemoveContainer" containerID="269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b"
Aug 04 00:04:48.078134 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.078113    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b"} err="failed to get container status \"269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b\": rpc error: code = NotFound desc = could not find container \"269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b\": container with ID starting with 269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b not found: ID does not exist"
Aug 04 00:04:48.078184 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.078137    2556 scope.go:117] "RemoveContainer" containerID="54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16"
Aug 04 00:04:48.078382 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.078357    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16"} err="failed to get container status \"54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16\": rpc error: code = NotFound desc = could not find container \"54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16\": container with ID starting with 54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16 not found: ID does not exist"
Aug 04 00:04:48.078382 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.078380    2556 scope.go:117] "RemoveContainer" containerID="b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6"
Aug 04 00:04:48.078652 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.078614    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6"} err="failed to get container status \"b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6\": rpc error: code = NotFound desc = could not find container \"b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6\": container with ID starting with b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6 not found: ID does not exist"
Aug 04 00:04:48.078652 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.078641    2556 scope.go:117] "RemoveContainer" containerID="2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080"
Aug 04 00:04:48.078915 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.078889    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080"} err="failed to get container status \"2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080\": rpc error: code = NotFound desc = could not find container \"2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080\": container with ID starting with 2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080 not found: ID does not exist"
Aug 04 00:04:48.079024 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.078917    2556 scope.go:117] "RemoveContainer" containerID="1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5"
Aug 04 00:04:48.079142 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.079119    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5"} err="failed to get container status \"1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5\": rpc error: code = NotFound desc = could not find container \"1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5\": container with ID starting with 1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5 not found: ID does not exist"
Aug 04 00:04:48.079210 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.079144    2556 scope.go:117] "RemoveContainer" containerID="e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e"
Aug 04 00:04:48.079510 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.079485    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e"} err="failed to get container status \"e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e\": rpc error: code = NotFound desc = could not find container \"e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e\": container with ID starting with e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e not found: ID does not exist"
Aug 04 00:04:48.079587 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.079527    2556 scope.go:117] "RemoveContainer" containerID="4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93"
Aug 04 00:04:48.079834 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.079806    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93"} err="failed to get container status \"4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93\": rpc error: code = NotFound desc = could not find container \"4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93\": container with ID starting with 4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93 not found: ID does not exist"
Aug 04 00:04:48.079917 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.079835    2556 scope.go:117] "RemoveContainer" containerID="269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b"
Aug 04 00:04:48.080234 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.080209    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b"} err="failed to get container status \"269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b\": rpc error: code = NotFound desc = could not find container \"269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b\": container with ID starting with 269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b not found: ID does not exist"
Aug 04 00:04:48.080234 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.080234    2556 scope.go:117] "RemoveContainer" containerID="54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16"
Aug 04 00:04:48.080525 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.080505    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16"} err="failed to get container status \"54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16\": rpc error: code = NotFound desc = could not find container \"54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16\": container with ID starting with 54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16 not found: ID does not exist"
Aug 04 00:04:48.080525 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.080524    2556 scope.go:117] "RemoveContainer" containerID="b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6"
Aug 04 00:04:48.080842 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.080820    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6"} err="failed to get container status \"b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6\": rpc error: code = NotFound desc = could not find container \"b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6\": container with ID starting with b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6 not found: ID does not exist"
Aug 04 00:04:48.080921 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.080843    2556 scope.go:117] "RemoveContainer" containerID="2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080"
Aug 04 00:04:48.081110 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.081082    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080"} err="failed to get container status \"2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080\": rpc error: code = NotFound desc = could not find container \"2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080\": container with ID starting with 2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080 not found: ID does not exist"
Aug 04 00:04:48.081110 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.081106    2556 scope.go:117] "RemoveContainer" containerID="1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5"
Aug 04 00:04:48.081444 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.081417    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5"} err="failed to get container status \"1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5\": rpc error: code = NotFound desc = could not find container \"1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5\": container with ID starting with 1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5 not found: ID does not exist"
Aug 04 00:04:48.081444 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.081443    2556 scope.go:117] "RemoveContainer" containerID="e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e"
Aug 04 00:04:48.081809 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.081786    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e"} err="failed to get container status \"e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e\": rpc error: code = NotFound desc = could not find container \"e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e\": container with ID starting with e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e not found: ID does not exist"
Aug 04 00:04:48.082125 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.081810    2556 scope.go:117] "RemoveContainer" containerID="4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93"
Aug 04 00:04:48.082125 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.082056    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93"} err="failed to get container status \"4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93\": rpc error: code = NotFound desc = could not find container \"4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93\": container with ID starting with 4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93 not found: ID does not exist"
Aug 04 00:04:48.082125 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.082078    2556 scope.go:117] "RemoveContainer" containerID="269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b"
Aug 04 00:04:48.082279 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.082200    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Aug 04 00:04:48.082279 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.082249    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Aug 04 00:04:48.082348 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.082305    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b"} err="failed to get container status \"269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b\": rpc error: code = NotFound desc = could not find container \"269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b\": container with ID starting with 269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b not found: ID does not exist"
Aug 04 00:04:48.082348 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.082328    2556 scope.go:117] "RemoveContainer" containerID="54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16"
Aug 04 00:04:48.082416 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.082393    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-20rua064mmps2\""
Aug 04 00:04:48.082680 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.082568    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Aug 04 00:04:48.082680 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.082611    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Aug 04 00:04:48.082680 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.082653    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Aug 04 00:04:48.082901 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.082613    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Aug 04 00:04:48.082901 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.082694    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Aug 04 00:04:48.082901 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.082753    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Aug 04 00:04:48.082901 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.082783    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16"} err="failed to get container status \"54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16\": rpc error: code = NotFound desc = could not find container \"54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16\": container with ID starting with 54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16 not found: ID does not exist"
Aug 04 00:04:48.082901 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.082885    2556 scope.go:117] "RemoveContainer" containerID="b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6"
Aug 04 00:04:48.083291 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.083268    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6"} err="failed to get container status \"b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6\": rpc error: code = NotFound desc = could not find container \"b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6\": container with ID starting with b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6 not found: ID does not exist"
Aug 04 00:04:48.083367 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.083294    2556 scope.go:117] "RemoveContainer" containerID="2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080"
Aug 04 00:04:48.083480 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.083458    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Aug 04 00:04:48.083560 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.083551    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Aug 04 00:04:48.083754 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.083695    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080"} err="failed to get container status \"2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080\": rpc error: code = NotFound desc = could not find container \"2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080\": container with ID starting with 2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080 not found: ID does not exist"
Aug 04 00:04:48.083754 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.083734    2556 scope.go:117] "RemoveContainer" containerID="1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5"
Aug 04 00:04:48.083921 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.083774    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Aug 04 00:04:48.083921 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.083857    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Aug 04 00:04:48.084043 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.083966    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vqnw5\""
Aug 04 00:04:48.084124 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.084029    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5"} err="failed to get container status \"1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5\": rpc error: code = NotFound desc = could not find container \"1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5\": container with ID starting with 1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5 not found: ID does not exist"
Aug 04 00:04:48.084363 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.084187    2556 scope.go:117] "RemoveContainer" containerID="e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e"
Aug 04 00:04:48.084827 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.084807    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Aug 04 00:04:48.085223 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.085077    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e"} err="failed to get container status \"e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e\": rpc error: code = NotFound desc = could not find container \"e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e\": container with ID starting with e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e not found: ID does not exist"
Aug 04 00:04:48.085223 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.085131    2556 scope.go:117] "RemoveContainer" containerID="4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93"
Aug 04 00:04:48.085492 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.085445    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93"} err="failed to get container status \"4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93\": rpc error: code = NotFound desc = could not find container \"4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93\": container with ID starting with 4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93 not found: ID does not exist"
Aug 04 00:04:48.085492 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.085468    2556 scope.go:117] "RemoveContainer" containerID="269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b"
Aug 04 00:04:48.085824 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.085736    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b"} err="failed to get container status \"269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b\": rpc error: code = NotFound desc = could not find container \"269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b\": container with ID starting with 269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b not found: ID does not exist"
Aug 04 00:04:48.085824 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.085762    2556 scope.go:117] "RemoveContainer" containerID="54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16"
Aug 04 00:04:48.086197 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.086153    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16"} err="failed to get container status \"54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16\": rpc error: code = NotFound desc = could not find container \"54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16\": container with ID starting with 54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16 not found: ID does not exist"
Aug 04 00:04:48.086197 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.086179    2556 scope.go:117] "RemoveContainer" containerID="b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6"
Aug 04 00:04:48.086582 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.086494    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6"} err="failed to get container status \"b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6\": rpc error: code = NotFound desc = could not find container \"b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6\": container with ID starting with b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6 not found: ID does not exist"
Aug 04 00:04:48.086582 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.086518    2556 scope.go:117] "RemoveContainer" containerID="2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080"
Aug 04 00:04:48.087205 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.086823    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080"} err="failed to get container status \"2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080\": rpc error: code = NotFound desc = could not find container \"2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080\": container with ID starting with 2b47fdba1d6d316a991cd9e1f5c32486c7acabbdb8f3dfcf812a83c9b9e6e080 not found: ID does not exist"
Aug 04 00:04:48.087205 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.086847    2556 scope.go:117] "RemoveContainer" containerID="1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5"
Aug 04 00:04:48.087205 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.087155    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Aug 04 00:04:48.087410 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.087378    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5"} err="failed to get container status \"1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5\": rpc error: code = NotFound desc = could not find container \"1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5\": container with ID starting with 1da08fa044349487922d07e5bd1a60333540eb7cb2eb9e19f9105523f23804c5 not found: ID does not exist"
Aug 04 00:04:48.087410 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.087405    2556 scope.go:117] "RemoveContainer" containerID="e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e"
Aug 04 00:04:48.087808 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.087700    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e"} err="failed to get container status \"e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e\": rpc error: code = NotFound desc = could not find container \"e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e\": container with ID starting with e6706e5a8fa218e21d6e08aeb1404c3226860acaeccf409d81773b3ff90fb15e not found: ID does not exist"
Aug 04 00:04:48.087808 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.087744    2556 scope.go:117] "RemoveContainer" containerID="4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93"
Aug 04 00:04:48.088182 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.088154    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93"} err="failed to get container status \"4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93\": rpc error: code = NotFound desc = could not find container \"4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93\": container with ID starting with 4b23b9ca8d1dc040dc07f956968ca44f0f9724a5e9bf9cd271fc7bfe9c0a1a93 not found: ID does not exist"
Aug 04 00:04:48.088182 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.088185    2556 scope.go:117] "RemoveContainer" containerID="269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b"
Aug 04 00:04:48.088467 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.088438    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b"} err="failed to get container status \"269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b\": rpc error: code = NotFound desc = could not find container \"269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b\": container with ID starting with 269011f0add3c2abb5c9093ef00db47014048027e4479a9ee5eaa6101b41fc3b not found: ID does not exist"
Aug 04 00:04:48.088467 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.088462    2556 scope.go:117] "RemoveContainer" containerID="54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16"
Aug 04 00:04:48.088833 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.088800    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16"} err="failed to get container status \"54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16\": rpc error: code = NotFound desc = could not find container \"54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16\": container with ID starting with 54dccad07e2fec383a2c3ff3dbd80c5ebe4937789887d754aa5a59b2b5cb2d16 not found: ID does not exist"
Aug 04 00:04:48.088833 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.088834    2556 scope.go:117] "RemoveContainer" containerID="b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6"
Aug 04 00:04:48.089091 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.089070    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6"} err="failed to get container status \"b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6\": rpc error: code = NotFound desc = could not find container \"b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6\": container with ID starting with b34f75bfd84e731c1b0af5676c9b68e19fba8f5bccb07b2f41e975b98db070f6 not found: ID does not exist"
Aug 04 00:04:48.089988 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.089960    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Aug 04 00:04:48.096665 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.096614    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 00:04:48.189259 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.189222    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks75b\" (UniqueName: \"kubernetes.io/projected/291cf0f7-2eab-4679-97dd-4be14941d34b-kube-api-access-ks75b\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.189259 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.189264    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-config\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.189502 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.189290    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/291cf0f7-2eab-4679-97dd-4be14941d34b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.189502 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.189314    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/291cf0f7-2eab-4679-97dd-4be14941d34b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.189502 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.189388    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/291cf0f7-2eab-4679-97dd-4be14941d34b-config-out\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.189502 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.189425    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/291cf0f7-2eab-4679-97dd-4be14941d34b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.189502 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.189453    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/291cf0f7-2eab-4679-97dd-4be14941d34b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.189502 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.189487    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.189759 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.189514    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.189759 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.189559    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/291cf0f7-2eab-4679-97dd-4be14941d34b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.189759 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.189584    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/291cf0f7-2eab-4679-97dd-4be14941d34b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.189759 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.189612    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/291cf0f7-2eab-4679-97dd-4be14941d34b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.189759 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.189633    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/291cf0f7-2eab-4679-97dd-4be14941d34b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.189759 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.189648    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.189759 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.189662    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.189759 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.189680    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.189759 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.189701    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.189759 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.189739    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.189759 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.189765    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-web-config\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.190102 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.189788    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/291cf0f7-2eab-4679-97dd-4be14941d34b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.290337 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.290252    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.290337 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.290289    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.290337 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.290316    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.290647 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.290342    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-web-config\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.290647 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.290376    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/291cf0f7-2eab-4679-97dd-4be14941d34b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.290647 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.290565    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks75b\" (UniqueName: \"kubernetes.io/projected/291cf0f7-2eab-4679-97dd-4be14941d34b-kube-api-access-ks75b\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.290647 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.290625    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-config\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.290910 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.290657    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/291cf0f7-2eab-4679-97dd-4be14941d34b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.290910 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.290686    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/291cf0f7-2eab-4679-97dd-4be14941d34b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.290910 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.290737    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/291cf0f7-2eab-4679-97dd-4be14941d34b-config-out\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.290910 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.290771    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/291cf0f7-2eab-4679-97dd-4be14941d34b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.290910 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.290794    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/291cf0f7-2eab-4679-97dd-4be14941d34b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.290910 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.290827    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.290910 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.290851    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.290910 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.290895    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/291cf0f7-2eab-4679-97dd-4be14941d34b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.291369 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.290926    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/291cf0f7-2eab-4679-97dd-4be14941d34b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.291369 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.290961    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/291cf0f7-2eab-4679-97dd-4be14941d34b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.291369 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.290998    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/291cf0f7-2eab-4679-97dd-4be14941d34b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.291369 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.291027    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.291369 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.291050    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.291609 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.291472    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/291cf0f7-2eab-4679-97dd-4be14941d34b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.291863 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.291836    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/291cf0f7-2eab-4679-97dd-4be14941d34b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.292050 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.292030    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/291cf0f7-2eab-4679-97dd-4be14941d34b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.294122 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.293291    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.294122 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.293393    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-web-config\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.294122 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.293411    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.294122 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.293799    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/291cf0f7-2eab-4679-97dd-4be14941d34b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.294122 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.294089    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/291cf0f7-2eab-4679-97dd-4be14941d34b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.294447 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.294380    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/291cf0f7-2eab-4679-97dd-4be14941d34b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.294447 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.294386    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/291cf0f7-2eab-4679-97dd-4be14941d34b-config-out\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.294447 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.294405    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/291cf0f7-2eab-4679-97dd-4be14941d34b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.295189 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.294737    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/291cf0f7-2eab-4679-97dd-4be14941d34b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.295189 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.295135    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-config\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.295339 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.295260    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.296482 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.296454    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.297004 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.296986    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.297184 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.297162    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.297266 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.297189    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/291cf0f7-2eab-4679-97dd-4be14941d34b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.297427 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.297411    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/291cf0f7-2eab-4679-97dd-4be14941d34b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.300262 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.300241    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks75b\" (UniqueName: \"kubernetes.io/projected/291cf0f7-2eab-4679-97dd-4be14941d34b-kube-api-access-ks75b\") pod \"prometheus-k8s-0\" (UID: \"291cf0f7-2eab-4679-97dd-4be14941d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.306311 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.306289    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6289e73d-ceb9-453b-9bf4-c35aba2f744c" path="/var/lib/kubelet/pods/6289e73d-ceb9-453b-9bf4-c35aba2f744c/volumes"
Aug 04 00:04:48.387894 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.387857    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:48.867550 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:48.867522    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 00:04:48.868950 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:04:48.868922    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod291cf0f7_2eab_4679_97dd_4be14941d34b.slice/crio-e4e7ddf1f1b2925f54d657e5effeaf42440ec0423497805f754a3e19ff1daaec WatchSource:0}: Error finding container e4e7ddf1f1b2925f54d657e5effeaf42440ec0423497805f754a3e19ff1daaec: Status 404 returned error can't find the container with id e4e7ddf1f1b2925f54d657e5effeaf42440ec0423497805f754a3e19ff1daaec
Aug 04 00:04:49.020030 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.019998    2556 generic.go:356] "Generic (PLEG): container finished" podID="291cf0f7-2eab-4679-97dd-4be14941d34b" containerID="1985614796d2a3ba91492abb953d2606393a695ab56979fcdbce4f08e8f74d3e" exitCode=0
Aug 04 00:04:49.020183 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.020098    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"291cf0f7-2eab-4679-97dd-4be14941d34b","Type":"ContainerDied","Data":"1985614796d2a3ba91492abb953d2606393a695ab56979fcdbce4f08e8f74d3e"}
Aug 04 00:04:49.020183 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.020172    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"291cf0f7-2eab-4679-97dd-4be14941d34b","Type":"ContainerStarted","Data":"e4e7ddf1f1b2925f54d657e5effeaf42440ec0423497805f754a3e19ff1daaec"}
Aug 04 00:04:49.023272 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.023245    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68" event={"ID":"e190f3cd-55a0-4492-ac8e-98c08d9e514d","Type":"ContainerStarted","Data":"7bb4702720604f3ece70edd0994203aa905ee19679a54d2693ea5afe42e99196"}
Aug 04 00:04:49.023373 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.023299    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68" event={"ID":"e190f3cd-55a0-4492-ac8e-98c08d9e514d","Type":"ContainerStarted","Data":"c936e5c9efd92af12008861d98994fa419cc98c80142e10c013f1cb9e4339120"}
Aug 04 00:04:49.023373 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.023320    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68" event={"ID":"e190f3cd-55a0-4492-ac8e-98c08d9e514d","Type":"ContainerStarted","Data":"39b100645e4386c2f8c15aa971f1edc38182495b096fafd1a7742fecbcd3a53e"}
Aug 04 00:04:49.069162 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.069118    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-9685c57b4-b9w68" podStartSLOduration=1.400361009 podStartE2EDuration="3.069099784s" totalImagesPullingTime="1.668738775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:04:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:04:49.067608095 +0000 UTC m=+143.236245468" watchObservedRunningTime="2026-08-04 00:04:49.069099784 +0000 UTC m=+143.237737153"
Aug 04 00:04:49.155754 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.154606    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f794d84b6-7mlp8"]
Aug 04 00:04:49.157917 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.157892    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:49.173436 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.173411    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f794d84b6-7mlp8"]
Aug 04 00:04:49.198888 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.198861    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fe086ee-416f-4a82-b742-6bc817274bcb-trusted-ca-bundle\") pod \"console-6f794d84b6-7mlp8\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") " pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:49.199010 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.198900    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fe086ee-416f-4a82-b742-6bc817274bcb-service-ca\") pod \"console-6f794d84b6-7mlp8\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") " pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:49.199010 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.198951    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0fe086ee-416f-4a82-b742-6bc817274bcb-oauth-serving-cert\") pod \"console-6f794d84b6-7mlp8\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") " pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:49.199010 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.198978    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0fe086ee-416f-4a82-b742-6bc817274bcb-console-oauth-config\") pod \"console-6f794d84b6-7mlp8\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") " pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:49.199161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.199010    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0fe086ee-416f-4a82-b742-6bc817274bcb-console-config\") pod \"console-6f794d84b6-7mlp8\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") " pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:49.199161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.199035    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttsvl\" (UniqueName: \"kubernetes.io/projected/0fe086ee-416f-4a82-b742-6bc817274bcb-kube-api-access-ttsvl\") pod \"console-6f794d84b6-7mlp8\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") " pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:49.199161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.199129    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0fe086ee-416f-4a82-b742-6bc817274bcb-console-serving-cert\") pod \"console-6f794d84b6-7mlp8\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") " pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:49.299628 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.299594    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0fe086ee-416f-4a82-b742-6bc817274bcb-console-serving-cert\") pod \"console-6f794d84b6-7mlp8\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") " pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:49.299753 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.299705    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fe086ee-416f-4a82-b742-6bc817274bcb-trusted-ca-bundle\") pod \"console-6f794d84b6-7mlp8\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") " pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:49.299815 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.299760    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fe086ee-416f-4a82-b742-6bc817274bcb-service-ca\") pod \"console-6f794d84b6-7mlp8\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") " pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:49.299867 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.299829    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0fe086ee-416f-4a82-b742-6bc817274bcb-oauth-serving-cert\") pod \"console-6f794d84b6-7mlp8\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") " pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:49.299867 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.299858    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0fe086ee-416f-4a82-b742-6bc817274bcb-console-oauth-config\") pod \"console-6f794d84b6-7mlp8\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") " pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:49.299981 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.299907    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0fe086ee-416f-4a82-b742-6bc817274bcb-console-config\") pod \"console-6f794d84b6-7mlp8\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") " pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:49.299981 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.299934    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttsvl\" (UniqueName: \"kubernetes.io/projected/0fe086ee-416f-4a82-b742-6bc817274bcb-kube-api-access-ttsvl\") pod \"console-6f794d84b6-7mlp8\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") " pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:49.300836 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.300734    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0fe086ee-416f-4a82-b742-6bc817274bcb-console-config\") pod \"console-6f794d84b6-7mlp8\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") " pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:49.300836 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.300801    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fe086ee-416f-4a82-b742-6bc817274bcb-trusted-ca-bundle\") pod \"console-6f794d84b6-7mlp8\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") " pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:49.301120 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.301094    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0fe086ee-416f-4a82-b742-6bc817274bcb-oauth-serving-cert\") pod \"console-6f794d84b6-7mlp8\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") " pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:49.301210 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.301133    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fe086ee-416f-4a82-b742-6bc817274bcb-service-ca\") pod \"console-6f794d84b6-7mlp8\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") " pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:49.302454 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.302421    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0fe086ee-416f-4a82-b742-6bc817274bcb-console-serving-cert\") pod \"console-6f794d84b6-7mlp8\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") " pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:49.303866 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.303124    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0fe086ee-416f-4a82-b742-6bc817274bcb-console-oauth-config\") pod \"console-6f794d84b6-7mlp8\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") " pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:49.310846 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.310796    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttsvl\" (UniqueName: \"kubernetes.io/projected/0fe086ee-416f-4a82-b742-6bc817274bcb-kube-api-access-ttsvl\") pod \"console-6f794d84b6-7mlp8\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") " pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:49.478668 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.478628    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:49.608696 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:49.608663    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f794d84b6-7mlp8"]
Aug 04 00:04:49.611777 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:04:49.611748    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fe086ee_416f_4a82_b742_6bc817274bcb.slice/crio-add58b7417aa0a81b889695a7a96e8ae795a1b23398b45ed15c06ac5da4d1a6f WatchSource:0}: Error finding container add58b7417aa0a81b889695a7a96e8ae795a1b23398b45ed15c06ac5da4d1a6f: Status 404 returned error can't find the container with id add58b7417aa0a81b889695a7a96e8ae795a1b23398b45ed15c06ac5da4d1a6f
Aug 04 00:04:50.039161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:50.039118    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"291cf0f7-2eab-4679-97dd-4be14941d34b","Type":"ContainerStarted","Data":"5efbb22877416ba9d4788527b8cb443bec392ab7aa83b327310d3ea67d644d1b"}
Aug 04 00:04:50.039354 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:50.039244    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"291cf0f7-2eab-4679-97dd-4be14941d34b","Type":"ContainerStarted","Data":"12958bed344ad348559fcc50be6e77cc49016929c41f6799c6c34e4670f0665b"}
Aug 04 00:04:50.039354 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:50.039288    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"291cf0f7-2eab-4679-97dd-4be14941d34b","Type":"ContainerStarted","Data":"c627951827e354c8fcff255dbc38a9e9c7cdee163c0fa8e1af47d7c5aa632e5a"}
Aug 04 00:04:50.039354 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:50.039337    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"291cf0f7-2eab-4679-97dd-4be14941d34b","Type":"ContainerStarted","Data":"fdae06d03b8b06df04bed94a594b18de1ec3680cf75f49161305c89594a8814c"}
Aug 04 00:04:50.039530 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:50.039377    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"291cf0f7-2eab-4679-97dd-4be14941d34b","Type":"ContainerStarted","Data":"1d68aef2acbff4c8b2ed9a0b67b3328a629f7887c850d4cf06b6c6d864b312ac"}
Aug 04 00:04:50.039530 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:50.039416    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"291cf0f7-2eab-4679-97dd-4be14941d34b","Type":"ContainerStarted","Data":"9968f91b434d8e13d446e8d7d86e24ebf7de8cbc6af1748aaa2358d7b8131dfc"}
Aug 04 00:04:50.043325 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:50.043243    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f794d84b6-7mlp8" event={"ID":"0fe086ee-416f-4a82-b742-6bc817274bcb","Type":"ContainerStarted","Data":"5ccf8ea0c9d3675a93972bab179935b37df61ec35a4563b3d25d3d09e5233f71"}
Aug 04 00:04:50.043325 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:50.043304    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f794d84b6-7mlp8" event={"ID":"0fe086ee-416f-4a82-b742-6bc817274bcb","Type":"ContainerStarted","Data":"add58b7417aa0a81b889695a7a96e8ae795a1b23398b45ed15c06ac5da4d1a6f"}
Aug 04 00:04:50.065967 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:50.065908    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.046015704 podStartE2EDuration="2.065892175s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.876471ms" isStatefulPod=false podCreationTimestamp="2026-08-04 00:04:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:04:50.064706611 +0000 UTC m=+144.233344006" watchObservedRunningTime="2026-08-04 00:04:50.065892175 +0000 UTC m=+144.234529544"
Aug 04 00:04:50.082425 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:50.082371    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f794d84b6-7mlp8" podStartSLOduration=1.082357386 podStartE2EDuration="1.082357386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:04:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:04:50.081773452 +0000 UTC m=+144.250410823" watchObservedRunningTime="2026-08-04 00:04:50.082357386 +0000 UTC m=+144.250994755"
Aug 04 00:04:53.388078 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:53.388032    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:04:59.479108 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:59.479077    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:59.479525 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:59.479129    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:04:59.484364 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:04:59.484341    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:05:00.089302 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:00.089272    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:05:00.134663 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:00.134631    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54689d648b-zmhsv"]
Aug 04 00:05:25.157753 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:25.157630    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54689d648b-zmhsv" podUID="71af9c9d-3ad9-4dcc-bec2-a5923fb3162b" containerName="console" containerID="cri-o://e49cf210450d81e6af69087c1635ba0e3a7e888e4e4a83fc96f1b26938c5e22a" gracePeriod=15
Aug 04 00:05:25.408338 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:25.408282    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:05:25.498301 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:25.498266    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-service-ca\") pod \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") "
Aug 04 00:05:25.498483 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:25.498315    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-oauth-serving-cert\") pod \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") "
Aug 04 00:05:25.498483 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:25.498358    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-console-config\") pod \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") "
Aug 04 00:05:25.498483 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:25.498409    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnbww\" (UniqueName: \"kubernetes.io/projected/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-kube-api-access-wnbww\") pod \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") "
Aug 04 00:05:25.498483 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:25.498463    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-console-oauth-config\") pod \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") "
Aug 04 00:05:25.498691 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:25.498489    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-trusted-ca-bundle\") pod \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") "
Aug 04 00:05:25.498691 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:25.498522    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-console-serving-cert\") pod \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\" (UID: \"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b\") "
Aug 04 00:05:25.498840 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:25.498806    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-service-ca" (OuterVolumeSpecName: "service-ca") pod "71af9c9d-3ad9-4dcc-bec2-a5923fb3162b" (UID: "71af9c9d-3ad9-4dcc-bec2-a5923fb3162b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:05:25.498897 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:25.498835    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-console-config" (OuterVolumeSpecName: "console-config") pod "71af9c9d-3ad9-4dcc-bec2-a5923fb3162b" (UID: "71af9c9d-3ad9-4dcc-bec2-a5923fb3162b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:05:25.498955 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:25.498932    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "71af9c9d-3ad9-4dcc-bec2-a5923fb3162b" (UID: "71af9c9d-3ad9-4dcc-bec2-a5923fb3162b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:05:25.498997 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:25.498947    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "71af9c9d-3ad9-4dcc-bec2-a5923fb3162b" (UID: "71af9c9d-3ad9-4dcc-bec2-a5923fb3162b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:05:25.500618 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:25.500588    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "71af9c9d-3ad9-4dcc-bec2-a5923fb3162b" (UID: "71af9c9d-3ad9-4dcc-bec2-a5923fb3162b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:05:25.500747 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:25.500626    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-kube-api-access-wnbww" (OuterVolumeSpecName: "kube-api-access-wnbww") pod "71af9c9d-3ad9-4dcc-bec2-a5923fb3162b" (UID: "71af9c9d-3ad9-4dcc-bec2-a5923fb3162b"). InnerVolumeSpecName "kube-api-access-wnbww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:05:25.500747 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:25.500661    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "71af9c9d-3ad9-4dcc-bec2-a5923fb3162b" (UID: "71af9c9d-3ad9-4dcc-bec2-a5923fb3162b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:05:25.599420 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:25.599389    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnbww\" (UniqueName: \"kubernetes.io/projected/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-kube-api-access-wnbww\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:05:25.599420 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:25.599416    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-console-oauth-config\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:05:25.599630 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:25.599428    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-trusted-ca-bundle\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:05:25.599630 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:25.599442    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-console-serving-cert\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:05:25.599630 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:25.599453    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-service-ca\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:05:25.599630 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:25.599465    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-oauth-serving-cert\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:05:25.599630 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:25.599476    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b-console-config\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:05:26.192804 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:26.192774    2556 generic.go:356] "Generic (PLEG): container finished" podID="71af9c9d-3ad9-4dcc-bec2-a5923fb3162b" containerID="e49cf210450d81e6af69087c1635ba0e3a7e888e4e4a83fc96f1b26938c5e22a" exitCode=0
Aug 04 00:05:26.193107 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:26.192827    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54689d648b-zmhsv"
Aug 04 00:05:26.193107 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:26.192868    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54689d648b-zmhsv" event={"ID":"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b","Type":"ContainerDied","Data":"e49cf210450d81e6af69087c1635ba0e3a7e888e4e4a83fc96f1b26938c5e22a"}
Aug 04 00:05:26.193107 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:26.192915    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54689d648b-zmhsv" event={"ID":"71af9c9d-3ad9-4dcc-bec2-a5923fb3162b","Type":"ContainerDied","Data":"da456dbe9c8d366ba507d9d7bea2d38efcb3c03bb666999f10bb5c47623fab6c"}
Aug 04 00:05:26.193107 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:26.192937    2556 scope.go:117] "RemoveContainer" containerID="e49cf210450d81e6af69087c1635ba0e3a7e888e4e4a83fc96f1b26938c5e22a"
Aug 04 00:05:26.201044 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:26.201025    2556 scope.go:117] "RemoveContainer" containerID="e49cf210450d81e6af69087c1635ba0e3a7e888e4e4a83fc96f1b26938c5e22a"
Aug 04 00:05:26.201278 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:05:26.201258    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e49cf210450d81e6af69087c1635ba0e3a7e888e4e4a83fc96f1b26938c5e22a\": container with ID starting with e49cf210450d81e6af69087c1635ba0e3a7e888e4e4a83fc96f1b26938c5e22a not found: ID does not exist" containerID="e49cf210450d81e6af69087c1635ba0e3a7e888e4e4a83fc96f1b26938c5e22a"
Aug 04 00:05:26.201338 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:26.201279    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e49cf210450d81e6af69087c1635ba0e3a7e888e4e4a83fc96f1b26938c5e22a"} err="failed to get container status \"e49cf210450d81e6af69087c1635ba0e3a7e888e4e4a83fc96f1b26938c5e22a\": rpc error: code = NotFound desc = could not find container \"e49cf210450d81e6af69087c1635ba0e3a7e888e4e4a83fc96f1b26938c5e22a\": container with ID starting with e49cf210450d81e6af69087c1635ba0e3a7e888e4e4a83fc96f1b26938c5e22a not found: ID does not exist"
Aug 04 00:05:26.214856 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:26.214625    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54689d648b-zmhsv"]
Aug 04 00:05:26.216074 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:26.216055    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54689d648b-zmhsv"]
Aug 04 00:05:26.305733 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:26.305683    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71af9c9d-3ad9-4dcc-bec2-a5923fb3162b" path="/var/lib/kubelet/pods/71af9c9d-3ad9-4dcc-bec2-a5923fb3162b/volumes"
Aug 04 00:05:48.388358 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:48.388306    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:05:48.403979 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:48.403950    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:05:49.297992 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:49.297958    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 00:05:59.019533 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.019496    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58b56856cd-2pm9z"]
Aug 04 00:05:59.019995 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.019863    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71af9c9d-3ad9-4dcc-bec2-a5923fb3162b" containerName="console"
Aug 04 00:05:59.019995 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.019876    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="71af9c9d-3ad9-4dcc-bec2-a5923fb3162b" containerName="console"
Aug 04 00:05:59.019995 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.019926    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="71af9c9d-3ad9-4dcc-bec2-a5923fb3162b" containerName="console"
Aug 04 00:05:59.023688 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.023669    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:05:59.035454 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.035430    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58b56856cd-2pm9z"]
Aug 04 00:05:59.110403 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.110359    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-console-oauth-config\") pod \"console-58b56856cd-2pm9z\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") " pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:05:59.110544 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.110411    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-console-config\") pod \"console-58b56856cd-2pm9z\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") " pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:05:59.110544 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.110460    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-service-ca\") pod \"console-58b56856cd-2pm9z\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") " pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:05:59.110544 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.110506    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n69rs\" (UniqueName: \"kubernetes.io/projected/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-kube-api-access-n69rs\") pod \"console-58b56856cd-2pm9z\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") " pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:05:59.110665 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.110554    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-oauth-serving-cert\") pod \"console-58b56856cd-2pm9z\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") " pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:05:59.110665 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.110623    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-console-serving-cert\") pod \"console-58b56856cd-2pm9z\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") " pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:05:59.110665 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.110644    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-trusted-ca-bundle\") pod \"console-58b56856cd-2pm9z\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") " pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:05:59.211386 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.211345    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-oauth-serving-cert\") pod \"console-58b56856cd-2pm9z\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") " pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:05:59.211546 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.211407    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-console-serving-cert\") pod \"console-58b56856cd-2pm9z\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") " pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:05:59.211546 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.211520    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-trusted-ca-bundle\") pod \"console-58b56856cd-2pm9z\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") " pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:05:59.211657 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.211597    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-console-oauth-config\") pod \"console-58b56856cd-2pm9z\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") " pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:05:59.211657 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.211629    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-console-config\") pod \"console-58b56856cd-2pm9z\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") " pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:05:59.211657 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.211643    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-service-ca\") pod \"console-58b56856cd-2pm9z\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") " pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:05:59.211845 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.211684    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n69rs\" (UniqueName: \"kubernetes.io/projected/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-kube-api-access-n69rs\") pod \"console-58b56856cd-2pm9z\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") " pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:05:59.212294 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.212265    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-oauth-serving-cert\") pod \"console-58b56856cd-2pm9z\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") " pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:05:59.212420 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.212352    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-trusted-ca-bundle\") pod \"console-58b56856cd-2pm9z\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") " pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:05:59.212420 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.212379    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-console-config\") pod \"console-58b56856cd-2pm9z\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") " pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:05:59.212420 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.212354    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-service-ca\") pod \"console-58b56856cd-2pm9z\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") " pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:05:59.214003 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.213977    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-console-oauth-config\") pod \"console-58b56856cd-2pm9z\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") " pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:05:59.214104 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.214023    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-console-serving-cert\") pod \"console-58b56856cd-2pm9z\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") " pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:05:59.221348 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.221326    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n69rs\" (UniqueName: \"kubernetes.io/projected/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-kube-api-access-n69rs\") pod \"console-58b56856cd-2pm9z\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") " pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:05:59.333088 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.333002    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:05:59.472158 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:05:59.472130    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58b56856cd-2pm9z"]
Aug 04 00:05:59.474657 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:05:59.474631    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e8da293_1075_47c9_ba1d_0bc6cf9350eb.slice/crio-484d2b1da30d702e5e00eb314e0e0f2beb866d3088c8448a7a9a0b7165769784 WatchSource:0}: Error finding container 484d2b1da30d702e5e00eb314e0e0f2beb866d3088c8448a7a9a0b7165769784: Status 404 returned error can't find the container with id 484d2b1da30d702e5e00eb314e0e0f2beb866d3088c8448a7a9a0b7165769784
Aug 04 00:06:00.328881 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:00.328845    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58b56856cd-2pm9z" event={"ID":"7e8da293-1075-47c9-ba1d-0bc6cf9350eb","Type":"ContainerStarted","Data":"a7ea5ba7941515848286e100d5e78eac5b3f2893163e44772d6b4625d9b57014"}
Aug 04 00:06:00.329259 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:00.328893    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58b56856cd-2pm9z" event={"ID":"7e8da293-1075-47c9-ba1d-0bc6cf9350eb","Type":"ContainerStarted","Data":"484d2b1da30d702e5e00eb314e0e0f2beb866d3088c8448a7a9a0b7165769784"}
Aug 04 00:06:00.345663 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:00.345610    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58b56856cd-2pm9z" podStartSLOduration=1.345593796 podStartE2EDuration="1.345593796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:05:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:06:00.344702736 +0000 UTC m=+214.513340105" watchObservedRunningTime="2026-08-04 00:06:00.345593796 +0000 UTC m=+214.514231168"
Aug 04 00:06:09.333988 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:09.333951    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:06:09.334478 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:09.334206    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:06:09.338891 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:09.338869    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:06:09.367541 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:09.367520    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:06:09.411692 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:09.411658    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f794d84b6-7mlp8"]
Aug 04 00:06:34.431258 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:34.431212    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f794d84b6-7mlp8" podUID="0fe086ee-416f-4a82-b742-6bc817274bcb" containerName="console" containerID="cri-o://5ccf8ea0c9d3675a93972bab179935b37df61ec35a4563b3d25d3d09e5233f71" gracePeriod=15
Aug 04 00:06:34.677859 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:34.677831    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:06:34.820980 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:34.820943    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fe086ee-416f-4a82-b742-6bc817274bcb-trusted-ca-bundle\") pod \"0fe086ee-416f-4a82-b742-6bc817274bcb\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") "
Aug 04 00:06:34.820980 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:34.820983    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0fe086ee-416f-4a82-b742-6bc817274bcb-oauth-serving-cert\") pod \"0fe086ee-416f-4a82-b742-6bc817274bcb\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") "
Aug 04 00:06:34.821229 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:34.821011    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttsvl\" (UniqueName: \"kubernetes.io/projected/0fe086ee-416f-4a82-b742-6bc817274bcb-kube-api-access-ttsvl\") pod \"0fe086ee-416f-4a82-b742-6bc817274bcb\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") "
Aug 04 00:06:34.821229 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:34.821062    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0fe086ee-416f-4a82-b742-6bc817274bcb-console-oauth-config\") pod \"0fe086ee-416f-4a82-b742-6bc817274bcb\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") "
Aug 04 00:06:34.821229 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:34.821100    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0fe086ee-416f-4a82-b742-6bc817274bcb-console-config\") pod \"0fe086ee-416f-4a82-b742-6bc817274bcb\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") "
Aug 04 00:06:34.821229 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:34.821121    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0fe086ee-416f-4a82-b742-6bc817274bcb-console-serving-cert\") pod \"0fe086ee-416f-4a82-b742-6bc817274bcb\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") "
Aug 04 00:06:34.821229 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:34.821162    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fe086ee-416f-4a82-b742-6bc817274bcb-service-ca\") pod \"0fe086ee-416f-4a82-b742-6bc817274bcb\" (UID: \"0fe086ee-416f-4a82-b742-6bc817274bcb\") "
Aug 04 00:06:34.821534 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:34.821472    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fe086ee-416f-4a82-b742-6bc817274bcb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0fe086ee-416f-4a82-b742-6bc817274bcb" (UID: "0fe086ee-416f-4a82-b742-6bc817274bcb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:06:34.821660 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:34.821594    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fe086ee-416f-4a82-b742-6bc817274bcb-service-ca" (OuterVolumeSpecName: "service-ca") pod "0fe086ee-416f-4a82-b742-6bc817274bcb" (UID: "0fe086ee-416f-4a82-b742-6bc817274bcb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:06:34.821660 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:34.821610    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fe086ee-416f-4a82-b742-6bc817274bcb-console-config" (OuterVolumeSpecName: "console-config") pod "0fe086ee-416f-4a82-b742-6bc817274bcb" (UID: "0fe086ee-416f-4a82-b742-6bc817274bcb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:06:34.821817 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:34.821666    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fe086ee-416f-4a82-b742-6bc817274bcb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0fe086ee-416f-4a82-b742-6bc817274bcb" (UID: "0fe086ee-416f-4a82-b742-6bc817274bcb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:06:34.823321 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:34.823295    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fe086ee-416f-4a82-b742-6bc817274bcb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0fe086ee-416f-4a82-b742-6bc817274bcb" (UID: "0fe086ee-416f-4a82-b742-6bc817274bcb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:06:34.823734 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:34.823690    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fe086ee-416f-4a82-b742-6bc817274bcb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0fe086ee-416f-4a82-b742-6bc817274bcb" (UID: "0fe086ee-416f-4a82-b742-6bc817274bcb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:06:34.823734 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:34.823702    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fe086ee-416f-4a82-b742-6bc817274bcb-kube-api-access-ttsvl" (OuterVolumeSpecName: "kube-api-access-ttsvl") pod "0fe086ee-416f-4a82-b742-6bc817274bcb" (UID: "0fe086ee-416f-4a82-b742-6bc817274bcb"). InnerVolumeSpecName "kube-api-access-ttsvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:06:34.922454 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:34.922419    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0fe086ee-416f-4a82-b742-6bc817274bcb-console-oauth-config\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:06:34.922454 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:34.922448    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0fe086ee-416f-4a82-b742-6bc817274bcb-console-config\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:06:34.922454 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:34.922459    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0fe086ee-416f-4a82-b742-6bc817274bcb-console-serving-cert\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:06:34.922682 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:34.922468    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fe086ee-416f-4a82-b742-6bc817274bcb-service-ca\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:06:34.922682 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:34.922476    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fe086ee-416f-4a82-b742-6bc817274bcb-trusted-ca-bundle\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:06:34.922682 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:34.922487    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0fe086ee-416f-4a82-b742-6bc817274bcb-oauth-serving-cert\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:06:34.922682 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:34.922496    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttsvl\" (UniqueName: \"kubernetes.io/projected/0fe086ee-416f-4a82-b742-6bc817274bcb-kube-api-access-ttsvl\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:06:35.475810 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:35.475778    2556 generic.go:356] "Generic (PLEG): container finished" podID="0fe086ee-416f-4a82-b742-6bc817274bcb" containerID="5ccf8ea0c9d3675a93972bab179935b37df61ec35a4563b3d25d3d09e5233f71" exitCode=0
Aug 04 00:06:35.475810 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:35.475815    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f794d84b6-7mlp8" event={"ID":"0fe086ee-416f-4a82-b742-6bc817274bcb","Type":"ContainerDied","Data":"5ccf8ea0c9d3675a93972bab179935b37df61ec35a4563b3d25d3d09e5233f71"}
Aug 04 00:06:35.476259 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:35.475823    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f794d84b6-7mlp8"
Aug 04 00:06:35.476259 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:35.475855    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f794d84b6-7mlp8" event={"ID":"0fe086ee-416f-4a82-b742-6bc817274bcb","Type":"ContainerDied","Data":"add58b7417aa0a81b889695a7a96e8ae795a1b23398b45ed15c06ac5da4d1a6f"}
Aug 04 00:06:35.476259 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:35.475876    2556 scope.go:117] "RemoveContainer" containerID="5ccf8ea0c9d3675a93972bab179935b37df61ec35a4563b3d25d3d09e5233f71"
Aug 04 00:06:35.484372 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:35.484355    2556 scope.go:117] "RemoveContainer" containerID="5ccf8ea0c9d3675a93972bab179935b37df61ec35a4563b3d25d3d09e5233f71"
Aug 04 00:06:35.484621 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:06:35.484600    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ccf8ea0c9d3675a93972bab179935b37df61ec35a4563b3d25d3d09e5233f71\": container with ID starting with 5ccf8ea0c9d3675a93972bab179935b37df61ec35a4563b3d25d3d09e5233f71 not found: ID does not exist" containerID="5ccf8ea0c9d3675a93972bab179935b37df61ec35a4563b3d25d3d09e5233f71"
Aug 04 00:06:35.484684 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:35.484634    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ccf8ea0c9d3675a93972bab179935b37df61ec35a4563b3d25d3d09e5233f71"} err="failed to get container status \"5ccf8ea0c9d3675a93972bab179935b37df61ec35a4563b3d25d3d09e5233f71\": rpc error: code = NotFound desc = could not find container \"5ccf8ea0c9d3675a93972bab179935b37df61ec35a4563b3d25d3d09e5233f71\": container with ID starting with 5ccf8ea0c9d3675a93972bab179935b37df61ec35a4563b3d25d3d09e5233f71 not found: ID does not exist"
Aug 04 00:06:35.497376 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:35.497347    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f794d84b6-7mlp8"]
Aug 04 00:06:35.501176 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:35.501151    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f794d84b6-7mlp8"]
Aug 04 00:06:36.309907 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:06:36.306931    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fe086ee-416f-4a82-b742-6bc817274bcb" path="/var/lib/kubelet/pods/0fe086ee-416f-4a82-b742-6bc817274bcb/volumes"
Aug 04 00:07:26.182016 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:26.181990    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:07:26.185053 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:26.185030    2556 kubelet.go:1648] "Image garbage collection succeeded"
Aug 04 00:07:26.186640 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:26.186624    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:07:34.231269 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:34.231229    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-k75ph"]
Aug 04 00:07:34.233732 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:34.231557    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fe086ee-416f-4a82-b742-6bc817274bcb" containerName="console"
Aug 04 00:07:34.233732 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:34.231568    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fe086ee-416f-4a82-b742-6bc817274bcb" containerName="console"
Aug 04 00:07:34.233732 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:34.231623    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fe086ee-416f-4a82-b742-6bc817274bcb" containerName="console"
Aug 04 00:07:34.234521 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:34.234505    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-k75ph"
Aug 04 00:07:34.237100 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:34.237079    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Aug 04 00:07:34.237225 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:34.237116    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Aug 04 00:07:34.237950 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:34.237934    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-77qvn\""
Aug 04 00:07:34.239510 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:34.239492    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/751c950c-9187-478e-ba7e-181d36599655-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-k75ph\" (UID: \"751c950c-9187-478e-ba7e-181d36599655\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k75ph"
Aug 04 00:07:34.239602 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:34.239526    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m685\" (UniqueName: \"kubernetes.io/projected/751c950c-9187-478e-ba7e-181d36599655-kube-api-access-9m685\") pod \"cert-manager-webhook-6486ffd997-k75ph\" (UID: \"751c950c-9187-478e-ba7e-181d36599655\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k75ph"
Aug 04 00:07:34.244182 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:34.244161    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-k75ph"]
Aug 04 00:07:34.340824 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:34.340788    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/751c950c-9187-478e-ba7e-181d36599655-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-k75ph\" (UID: \"751c950c-9187-478e-ba7e-181d36599655\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k75ph"
Aug 04 00:07:34.341105 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:34.340870    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m685\" (UniqueName: \"kubernetes.io/projected/751c950c-9187-478e-ba7e-181d36599655-kube-api-access-9m685\") pod \"cert-manager-webhook-6486ffd997-k75ph\" (UID: \"751c950c-9187-478e-ba7e-181d36599655\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k75ph"
Aug 04 00:07:34.349675 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:34.349643    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/751c950c-9187-478e-ba7e-181d36599655-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-k75ph\" (UID: \"751c950c-9187-478e-ba7e-181d36599655\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k75ph"
Aug 04 00:07:34.349849 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:34.349786    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m685\" (UniqueName: \"kubernetes.io/projected/751c950c-9187-478e-ba7e-181d36599655-kube-api-access-9m685\") pod \"cert-manager-webhook-6486ffd997-k75ph\" (UID: \"751c950c-9187-478e-ba7e-181d36599655\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k75ph"
Aug 04 00:07:34.561978 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:34.561945    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-k75ph"
Aug 04 00:07:34.689805 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:34.689772    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-k75ph"]
Aug 04 00:07:34.693145 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:07:34.693117    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod751c950c_9187_478e_ba7e_181d36599655.slice/crio-118ca3b30dec61d96ce56af862964f6c27a180d8aca9ff6fa03e85c504f1ca00 WatchSource:0}: Error finding container 118ca3b30dec61d96ce56af862964f6c27a180d8aca9ff6fa03e85c504f1ca00: Status 404 returned error can't find the container with id 118ca3b30dec61d96ce56af862964f6c27a180d8aca9ff6fa03e85c504f1ca00
Aug 04 00:07:34.695121 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:34.695105    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 00:07:34.706937 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:34.706905    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-k75ph" event={"ID":"751c950c-9187-478e-ba7e-181d36599655","Type":"ContainerStarted","Data":"118ca3b30dec61d96ce56af862964f6c27a180d8aca9ff6fa03e85c504f1ca00"}
Aug 04 00:07:40.734972 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:40.734931    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-k75ph" event={"ID":"751c950c-9187-478e-ba7e-181d36599655","Type":"ContainerStarted","Data":"d1b3cb961ecf45410eb101d9288e299876d3151a3d7ee2a11075b3e663d1b2ae"}
Aug 04 00:07:40.735420 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:40.735165    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-k75ph"
Aug 04 00:07:40.752942 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:40.752895    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-k75ph" podStartSLOduration=0.829062233 podStartE2EDuration="6.752881519s" totalImagesPullingTime="5.923819286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:07:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:07:40.751814692 +0000 UTC m=+314.920452060" watchObservedRunningTime="2026-08-04 00:07:40.752881519 +0000 UTC m=+314.921518887"
Aug 04 00:07:46.744486 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:07:46.744453    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-k75ph"
Aug 04 00:08:06.166005 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.165973    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd"]
Aug 04 00:08:06.169538 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.169508    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd"
Aug 04 00:08:06.175992 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.175843    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 04 00:08:06.175992 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.175861    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rp998\""
Aug 04 00:08:06.176089 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.175997    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 04 00:08:06.176185 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.176163    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 04 00:08:06.176185 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.176177    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 04 00:08:06.195280 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.195251    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd"]
Aug 04 00:08:06.322806 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.322759    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df99b7ed-d36e-490e-87d4-53cb35e0ef95-tmp\") pod \"opendatahub-operator-controller-manager-8594b76987-dvncd\" (UID: \"df99b7ed-d36e-490e-87d4-53cb35e0ef95\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd"
Aug 04 00:08:06.322806 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.322801    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/df99b7ed-d36e-490e-87d4-53cb35e0ef95-manifests\") pod \"opendatahub-operator-controller-manager-8594b76987-dvncd\" (UID: \"df99b7ed-d36e-490e-87d4-53cb35e0ef95\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd"
Aug 04 00:08:06.323046 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.322833    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtjwz\" (UniqueName: \"kubernetes.io/projected/df99b7ed-d36e-490e-87d4-53cb35e0ef95-kube-api-access-xtjwz\") pod \"opendatahub-operator-controller-manager-8594b76987-dvncd\" (UID: \"df99b7ed-d36e-490e-87d4-53cb35e0ef95\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd"
Aug 04 00:08:06.323046 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.322913    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/df99b7ed-d36e-490e-87d4-53cb35e0ef95-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8594b76987-dvncd\" (UID: \"df99b7ed-d36e-490e-87d4-53cb35e0ef95\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd"
Aug 04 00:08:06.323046 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.322969    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df99b7ed-d36e-490e-87d4-53cb35e0ef95-webhook-cert\") pod \"opendatahub-operator-controller-manager-8594b76987-dvncd\" (UID: \"df99b7ed-d36e-490e-87d4-53cb35e0ef95\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd"
Aug 04 00:08:06.424795 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.424044    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df99b7ed-d36e-490e-87d4-53cb35e0ef95-tmp\") pod \"opendatahub-operator-controller-manager-8594b76987-dvncd\" (UID: \"df99b7ed-d36e-490e-87d4-53cb35e0ef95\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd"
Aug 04 00:08:06.424795 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.424101    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/df99b7ed-d36e-490e-87d4-53cb35e0ef95-manifests\") pod \"opendatahub-operator-controller-manager-8594b76987-dvncd\" (UID: \"df99b7ed-d36e-490e-87d4-53cb35e0ef95\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd"
Aug 04 00:08:06.424795 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.424135    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtjwz\" (UniqueName: \"kubernetes.io/projected/df99b7ed-d36e-490e-87d4-53cb35e0ef95-kube-api-access-xtjwz\") pod \"opendatahub-operator-controller-manager-8594b76987-dvncd\" (UID: \"df99b7ed-d36e-490e-87d4-53cb35e0ef95\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd"
Aug 04 00:08:06.424795 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.424197    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/df99b7ed-d36e-490e-87d4-53cb35e0ef95-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8594b76987-dvncd\" (UID: \"df99b7ed-d36e-490e-87d4-53cb35e0ef95\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd"
Aug 04 00:08:06.424795 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.424245    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df99b7ed-d36e-490e-87d4-53cb35e0ef95-webhook-cert\") pod \"opendatahub-operator-controller-manager-8594b76987-dvncd\" (UID: \"df99b7ed-d36e-490e-87d4-53cb35e0ef95\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd"
Aug 04 00:08:06.425916 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.425889    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/df99b7ed-d36e-490e-87d4-53cb35e0ef95-manifests\") pod \"opendatahub-operator-controller-manager-8594b76987-dvncd\" (UID: \"df99b7ed-d36e-490e-87d4-53cb35e0ef95\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd"
Aug 04 00:08:06.430122 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.430093    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df99b7ed-d36e-490e-87d4-53cb35e0ef95-tmp\") pod \"opendatahub-operator-controller-manager-8594b76987-dvncd\" (UID: \"df99b7ed-d36e-490e-87d4-53cb35e0ef95\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd"
Aug 04 00:08:06.430303 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.430280    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df99b7ed-d36e-490e-87d4-53cb35e0ef95-webhook-cert\") pod \"opendatahub-operator-controller-manager-8594b76987-dvncd\" (UID: \"df99b7ed-d36e-490e-87d4-53cb35e0ef95\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd"
Aug 04 00:08:06.431761 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.431736    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/df99b7ed-d36e-490e-87d4-53cb35e0ef95-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8594b76987-dvncd\" (UID: \"df99b7ed-d36e-490e-87d4-53cb35e0ef95\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd"
Aug 04 00:08:06.438087 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.438064    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtjwz\" (UniqueName: \"kubernetes.io/projected/df99b7ed-d36e-490e-87d4-53cb35e0ef95-kube-api-access-xtjwz\") pod \"opendatahub-operator-controller-manager-8594b76987-dvncd\" (UID: \"df99b7ed-d36e-490e-87d4-53cb35e0ef95\") " pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd"
Aug 04 00:08:06.482964 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.482928    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd"
Aug 04 00:08:06.651291 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.651263    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd"]
Aug 04 00:08:06.654327 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:08:06.654299    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf99b7ed_d36e_490e_87d4_53cb35e0ef95.slice/crio-d77baeed269954f7c58ef28c076d687d49b08616c781a7cc8c2938585ea1a565 WatchSource:0}: Error finding container d77baeed269954f7c58ef28c076d687d49b08616c781a7cc8c2938585ea1a565: Status 404 returned error can't find the container with id d77baeed269954f7c58ef28c076d687d49b08616c781a7cc8c2938585ea1a565
Aug 04 00:08:06.842170 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:06.842138    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd" event={"ID":"df99b7ed-d36e-490e-87d4-53cb35e0ef95","Type":"ContainerStarted","Data":"d77baeed269954f7c58ef28c076d687d49b08616c781a7cc8c2938585ea1a565"}
Aug 04 00:08:09.856908 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:09.856832    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd" event={"ID":"df99b7ed-d36e-490e-87d4-53cb35e0ef95","Type":"ContainerStarted","Data":"0ba710f3aee5b9692d43c91e059161ea10a8946cb150e745d7a1f3d1b2730d7e"}
Aug 04 00:08:10.862605 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:10.862568    2556 generic.go:356] "Generic (PLEG): container finished" podID="df99b7ed-d36e-490e-87d4-53cb35e0ef95" containerID="0ba710f3aee5b9692d43c91e059161ea10a8946cb150e745d7a1f3d1b2730d7e" exitCode=0
Aug 04 00:08:10.863070 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:10.862665    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd" event={"ID":"df99b7ed-d36e-490e-87d4-53cb35e0ef95","Type":"ContainerDied","Data":"0ba710f3aee5b9692d43c91e059161ea10a8946cb150e745d7a1f3d1b2730d7e"}
Aug 04 00:08:11.869641 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:11.869604    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd" event={"ID":"df99b7ed-d36e-490e-87d4-53cb35e0ef95","Type":"ContainerStarted","Data":"22fe4134477283aa682e08080dc469be48dc2328885a9d094e616d084eae503d"}
Aug 04 00:08:11.870055 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:11.869731    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd"
Aug 04 00:08:11.890738 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:11.890674    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd" podStartSLOduration=1.593633762 podStartE2EDuration="5.890659424s" totalImagesPullingTime="3.233633394s" totalInitContainerRuntime="1.063392268s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:08:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:08:11.888627494 +0000 UTC m=+346.057264865" watchObservedRunningTime="2026-08-04 00:08:11.890659424 +0000 UTC m=+346.059296794"
Aug 04 00:08:22.347894 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.347812    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6699cbcb6b-tkt8v"]
Aug 04 00:08:22.351161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.351139    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:22.361920 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.361896    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6699cbcb6b-tkt8v"]
Aug 04 00:08:22.366541 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.366507    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80f96fe0-858e-45ce-9fa6-f659a7365e97-oauth-serving-cert\") pod \"console-6699cbcb6b-tkt8v\" (UID: \"80f96fe0-858e-45ce-9fa6-f659a7365e97\") " pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:22.366680 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.366570    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80f96fe0-858e-45ce-9fa6-f659a7365e97-console-config\") pod \"console-6699cbcb6b-tkt8v\" (UID: \"80f96fe0-858e-45ce-9fa6-f659a7365e97\") " pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:22.366680 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.366613    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80f96fe0-858e-45ce-9fa6-f659a7365e97-service-ca\") pod \"console-6699cbcb6b-tkt8v\" (UID: \"80f96fe0-858e-45ce-9fa6-f659a7365e97\") " pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:22.366680 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.366650    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80f96fe0-858e-45ce-9fa6-f659a7365e97-console-serving-cert\") pod \"console-6699cbcb6b-tkt8v\" (UID: \"80f96fe0-858e-45ce-9fa6-f659a7365e97\") " pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:22.366680 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.366677    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80f96fe0-858e-45ce-9fa6-f659a7365e97-console-oauth-config\") pod \"console-6699cbcb6b-tkt8v\" (UID: \"80f96fe0-858e-45ce-9fa6-f659a7365e97\") " pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:22.366839 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.366760    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80f96fe0-858e-45ce-9fa6-f659a7365e97-trusted-ca-bundle\") pod \"console-6699cbcb6b-tkt8v\" (UID: \"80f96fe0-858e-45ce-9fa6-f659a7365e97\") " pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:22.366839 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.366777    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqvjp\" (UniqueName: \"kubernetes.io/projected/80f96fe0-858e-45ce-9fa6-f659a7365e97-kube-api-access-xqvjp\") pod \"console-6699cbcb6b-tkt8v\" (UID: \"80f96fe0-858e-45ce-9fa6-f659a7365e97\") " pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:22.467155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.467113    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80f96fe0-858e-45ce-9fa6-f659a7365e97-oauth-serving-cert\") pod \"console-6699cbcb6b-tkt8v\" (UID: \"80f96fe0-858e-45ce-9fa6-f659a7365e97\") " pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:22.467155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.467158    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80f96fe0-858e-45ce-9fa6-f659a7365e97-console-config\") pod \"console-6699cbcb6b-tkt8v\" (UID: \"80f96fe0-858e-45ce-9fa6-f659a7365e97\") " pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:22.467392 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.467180    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80f96fe0-858e-45ce-9fa6-f659a7365e97-service-ca\") pod \"console-6699cbcb6b-tkt8v\" (UID: \"80f96fe0-858e-45ce-9fa6-f659a7365e97\") " pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:22.467392 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.467199    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80f96fe0-858e-45ce-9fa6-f659a7365e97-console-serving-cert\") pod \"console-6699cbcb6b-tkt8v\" (UID: \"80f96fe0-858e-45ce-9fa6-f659a7365e97\") " pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:22.467392 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.467311    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80f96fe0-858e-45ce-9fa6-f659a7365e97-console-oauth-config\") pod \"console-6699cbcb6b-tkt8v\" (UID: \"80f96fe0-858e-45ce-9fa6-f659a7365e97\") " pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:22.467392 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.467376    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80f96fe0-858e-45ce-9fa6-f659a7365e97-trusted-ca-bundle\") pod \"console-6699cbcb6b-tkt8v\" (UID: \"80f96fe0-858e-45ce-9fa6-f659a7365e97\") " pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:22.467599 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.467402    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqvjp\" (UniqueName: \"kubernetes.io/projected/80f96fe0-858e-45ce-9fa6-f659a7365e97-kube-api-access-xqvjp\") pod \"console-6699cbcb6b-tkt8v\" (UID: \"80f96fe0-858e-45ce-9fa6-f659a7365e97\") " pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:22.468052 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.468021    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80f96fe0-858e-45ce-9fa6-f659a7365e97-oauth-serving-cert\") pod \"console-6699cbcb6b-tkt8v\" (UID: \"80f96fe0-858e-45ce-9fa6-f659a7365e97\") " pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:22.468052 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.468036    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80f96fe0-858e-45ce-9fa6-f659a7365e97-console-config\") pod \"console-6699cbcb6b-tkt8v\" (UID: \"80f96fe0-858e-45ce-9fa6-f659a7365e97\") " pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:22.468291 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.468021    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80f96fe0-858e-45ce-9fa6-f659a7365e97-service-ca\") pod \"console-6699cbcb6b-tkt8v\" (UID: \"80f96fe0-858e-45ce-9fa6-f659a7365e97\") " pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:22.468291 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.468190    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80f96fe0-858e-45ce-9fa6-f659a7365e97-trusted-ca-bundle\") pod \"console-6699cbcb6b-tkt8v\" (UID: \"80f96fe0-858e-45ce-9fa6-f659a7365e97\") " pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:22.469662 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.469631    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80f96fe0-858e-45ce-9fa6-f659a7365e97-console-serving-cert\") pod \"console-6699cbcb6b-tkt8v\" (UID: \"80f96fe0-858e-45ce-9fa6-f659a7365e97\") " pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:22.469769 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.469695    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80f96fe0-858e-45ce-9fa6-f659a7365e97-console-oauth-config\") pod \"console-6699cbcb6b-tkt8v\" (UID: \"80f96fe0-858e-45ce-9fa6-f659a7365e97\") " pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:22.476992 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.476964    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqvjp\" (UniqueName: \"kubernetes.io/projected/80f96fe0-858e-45ce-9fa6-f659a7365e97-kube-api-access-xqvjp\") pod \"console-6699cbcb6b-tkt8v\" (UID: \"80f96fe0-858e-45ce-9fa6-f659a7365e97\") " pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:22.660124 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.660035    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:22.791812 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.791606    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6699cbcb6b-tkt8v"]
Aug 04 00:08:22.794456 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:08:22.794429    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f96fe0_858e_45ce_9fa6_f659a7365e97.slice/crio-489e16f5fc0a2d7241920f84061e48eebc706146a291e7fc3e5009c8762916d4 WatchSource:0}: Error finding container 489e16f5fc0a2d7241920f84061e48eebc706146a291e7fc3e5009c8762916d4: Status 404 returned error can't find the container with id 489e16f5fc0a2d7241920f84061e48eebc706146a291e7fc3e5009c8762916d4
Aug 04 00:08:22.876352 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.876321    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8594b76987-dvncd"
Aug 04 00:08:22.920188 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.920090    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6699cbcb6b-tkt8v" event={"ID":"80f96fe0-858e-45ce-9fa6-f659a7365e97","Type":"ContainerStarted","Data":"9a785160c7c05dc93dea3214ecbfae913c4bf3b106e216de32ad7b4642beb864"}
Aug 04 00:08:22.920188 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.920154    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6699cbcb6b-tkt8v" event={"ID":"80f96fe0-858e-45ce-9fa6-f659a7365e97","Type":"ContainerStarted","Data":"489e16f5fc0a2d7241920f84061e48eebc706146a291e7fc3e5009c8762916d4"}
Aug 04 00:08:22.944858 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:22.944800    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6699cbcb6b-tkt8v" podStartSLOduration=0.944781224 podStartE2EDuration="944.781224ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:08:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:08:22.943225062 +0000 UTC m=+357.111862440" watchObservedRunningTime="2026-08-04 00:08:22.944781224 +0000 UTC m=+357.113418592"
Aug 04 00:08:25.362978 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:25.362940    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-57f7cf7b5f-9tfr9"]
Aug 04 00:08:25.366363 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:25.366346    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57f7cf7b5f-9tfr9"
Aug 04 00:08:25.369868 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:25.369846    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 04 00:08:25.371056 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:25.371010    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mkj6k\""
Aug 04 00:08:25.371337 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:25.371320    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Aug 04 00:08:25.371337 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:25.371321    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Aug 04 00:08:25.371497 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:25.371321    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 04 00:08:25.382685 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:25.382657    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57f7cf7b5f-9tfr9"]
Aug 04 00:08:25.394452 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:25.394428    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc1812f9-3025-4c7d-8841-479b66bd453a-tmp\") pod \"kube-auth-proxy-57f7cf7b5f-9tfr9\" (UID: \"cc1812f9-3025-4c7d-8841-479b66bd453a\") " pod="openshift-ingress/kube-auth-proxy-57f7cf7b5f-9tfr9"
Aug 04 00:08:25.394592 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:25.394481    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc1812f9-3025-4c7d-8841-479b66bd453a-tls-certs\") pod \"kube-auth-proxy-57f7cf7b5f-9tfr9\" (UID: \"cc1812f9-3025-4c7d-8841-479b66bd453a\") " pod="openshift-ingress/kube-auth-proxy-57f7cf7b5f-9tfr9"
Aug 04 00:08:25.394592 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:25.394507    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvqpl\" (UniqueName: \"kubernetes.io/projected/cc1812f9-3025-4c7d-8841-479b66bd453a-kube-api-access-gvqpl\") pod \"kube-auth-proxy-57f7cf7b5f-9tfr9\" (UID: \"cc1812f9-3025-4c7d-8841-479b66bd453a\") " pod="openshift-ingress/kube-auth-proxy-57f7cf7b5f-9tfr9"
Aug 04 00:08:25.495645 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:25.495616    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc1812f9-3025-4c7d-8841-479b66bd453a-tmp\") pod \"kube-auth-proxy-57f7cf7b5f-9tfr9\" (UID: \"cc1812f9-3025-4c7d-8841-479b66bd453a\") " pod="openshift-ingress/kube-auth-proxy-57f7cf7b5f-9tfr9"
Aug 04 00:08:25.495862 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:25.495686    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc1812f9-3025-4c7d-8841-479b66bd453a-tls-certs\") pod \"kube-auth-proxy-57f7cf7b5f-9tfr9\" (UID: \"cc1812f9-3025-4c7d-8841-479b66bd453a\") " pod="openshift-ingress/kube-auth-proxy-57f7cf7b5f-9tfr9"
Aug 04 00:08:25.495862 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:25.495731    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvqpl\" (UniqueName: \"kubernetes.io/projected/cc1812f9-3025-4c7d-8841-479b66bd453a-kube-api-access-gvqpl\") pod \"kube-auth-proxy-57f7cf7b5f-9tfr9\" (UID: \"cc1812f9-3025-4c7d-8841-479b66bd453a\") " pod="openshift-ingress/kube-auth-proxy-57f7cf7b5f-9tfr9"
Aug 04 00:08:25.497949 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:25.497923    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc1812f9-3025-4c7d-8841-479b66bd453a-tmp\") pod \"kube-auth-proxy-57f7cf7b5f-9tfr9\" (UID: \"cc1812f9-3025-4c7d-8841-479b66bd453a\") " pod="openshift-ingress/kube-auth-proxy-57f7cf7b5f-9tfr9"
Aug 04 00:08:25.498093 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:25.498053    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc1812f9-3025-4c7d-8841-479b66bd453a-tls-certs\") pod \"kube-auth-proxy-57f7cf7b5f-9tfr9\" (UID: \"cc1812f9-3025-4c7d-8841-479b66bd453a\") " pod="openshift-ingress/kube-auth-proxy-57f7cf7b5f-9tfr9"
Aug 04 00:08:25.506706 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:25.506676    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvqpl\" (UniqueName: \"kubernetes.io/projected/cc1812f9-3025-4c7d-8841-479b66bd453a-kube-api-access-gvqpl\") pod \"kube-auth-proxy-57f7cf7b5f-9tfr9\" (UID: \"cc1812f9-3025-4c7d-8841-479b66bd453a\") " pod="openshift-ingress/kube-auth-proxy-57f7cf7b5f-9tfr9"
Aug 04 00:08:25.676736 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:25.676624    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57f7cf7b5f-9tfr9"
Aug 04 00:08:25.810226 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:25.810189    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57f7cf7b5f-9tfr9"]
Aug 04 00:08:25.812119 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:08:25.812078    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc1812f9_3025_4c7d_8841_479b66bd453a.slice/crio-e053d0b97300260ab4466dadc34307e4f8f25efd11f5e909c65ab5143632d8a8 WatchSource:0}: Error finding container e053d0b97300260ab4466dadc34307e4f8f25efd11f5e909c65ab5143632d8a8: Status 404 returned error can't find the container with id e053d0b97300260ab4466dadc34307e4f8f25efd11f5e909c65ab5143632d8a8
Aug 04 00:08:25.935008 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:25.934930    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57f7cf7b5f-9tfr9" event={"ID":"cc1812f9-3025-4c7d-8841-479b66bd453a","Type":"ContainerStarted","Data":"e053d0b97300260ab4466dadc34307e4f8f25efd11f5e909c65ab5143632d8a8"}
Aug 04 00:08:29.079096 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:29.079068    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Aug 04 00:08:29.955908 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:29.955873    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57f7cf7b5f-9tfr9" event={"ID":"cc1812f9-3025-4c7d-8841-479b66bd453a","Type":"ContainerStarted","Data":"d092aeb43bf20f36725c1918c7fd9da1ac9062bedff99c43b9a9eeabdbd95c18"}
Aug 04 00:08:29.979261 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:29.979207    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-57f7cf7b5f-9tfr9" podStartSLOduration=1.716580065 podStartE2EDuration="4.979189455s" totalImagesPullingTime="3.26260939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:08:29.978746507 +0000 UTC m=+364.147383870" watchObservedRunningTime="2026-08-04 00:08:29.979189455 +0000 UTC m=+364.147826860"
Aug 04 00:08:32.660514 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:32.660474    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:32.660933 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:32.660542    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:32.665641 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:32.665616    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:32.972749 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:32.972641    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6699cbcb6b-tkt8v"
Aug 04 00:08:33.025252 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.025218    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58b56856cd-2pm9z"]
Aug 04 00:08:33.511230 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.511193    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"]
Aug 04 00:08:33.514815 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.514791    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.517556 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.517531    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 04 00:08:33.517892 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.517875    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-d6wxr\""
Aug 04 00:08:33.531832 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.531801    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"]
Aug 04 00:08:33.570780 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.570741    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/044a1248-d03f-4909-96b4-637aee3a2ebf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.571031 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.570801    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/044a1248-d03f-4909-96b4-637aee3a2ebf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.571031 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.570842    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/044a1248-d03f-4909-96b4-637aee3a2ebf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.571031 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.570925    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/044a1248-d03f-4909-96b4-637aee3a2ebf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.571031 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.570955    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/044a1248-d03f-4909-96b4-637aee3a2ebf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.571031 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.571007    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xg7r\" (UniqueName: \"kubernetes.io/projected/044a1248-d03f-4909-96b4-637aee3a2ebf-kube-api-access-7xg7r\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.571308 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.571081    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/044a1248-d03f-4909-96b4-637aee3a2ebf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.571308 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.571122    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/044a1248-d03f-4909-96b4-637aee3a2ebf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.571308 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.571147    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/044a1248-d03f-4909-96b4-637aee3a2ebf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.672291 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.672253    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xg7r\" (UniqueName: \"kubernetes.io/projected/044a1248-d03f-4909-96b4-637aee3a2ebf-kube-api-access-7xg7r\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.672777 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.672303    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/044a1248-d03f-4909-96b4-637aee3a2ebf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.672777 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.672327    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/044a1248-d03f-4909-96b4-637aee3a2ebf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.672777 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.672347    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/044a1248-d03f-4909-96b4-637aee3a2ebf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.672777 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.672372    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/044a1248-d03f-4909-96b4-637aee3a2ebf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.672777 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.672395    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/044a1248-d03f-4909-96b4-637aee3a2ebf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.672777 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.672425    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/044a1248-d03f-4909-96b4-637aee3a2ebf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.672777 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.672486    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/044a1248-d03f-4909-96b4-637aee3a2ebf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.672777 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.672508    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/044a1248-d03f-4909-96b4-637aee3a2ebf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.673146 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.672873    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/044a1248-d03f-4909-96b4-637aee3a2ebf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.673146 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.672949    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/044a1248-d03f-4909-96b4-637aee3a2ebf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.673146 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.672994    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/044a1248-d03f-4909-96b4-637aee3a2ebf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.673146 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.673040    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/044a1248-d03f-4909-96b4-637aee3a2ebf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.673273 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.673185    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/044a1248-d03f-4909-96b4-637aee3a2ebf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.674909 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.674889    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/044a1248-d03f-4909-96b4-637aee3a2ebf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.675035 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.675016    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/044a1248-d03f-4909-96b4-637aee3a2ebf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.682550 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.682524    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/044a1248-d03f-4909-96b4-637aee3a2ebf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.682760 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.682738    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xg7r\" (UniqueName: \"kubernetes.io/projected/044a1248-d03f-4909-96b4-637aee3a2ebf-kube-api-access-7xg7r\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf\" (UID: \"044a1248-d03f-4909-96b4-637aee3a2ebf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.830428 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.830323    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:33.980655 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:33.980627    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"]
Aug 04 00:08:33.983183 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:08:33.983150    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod044a1248_d03f_4909_96b4_637aee3a2ebf.slice/crio-495202f510ad211ea32e169e2c088c453b8e89fbaff2906c9c4d7173a5439d86 WatchSource:0}: Error finding container 495202f510ad211ea32e169e2c088c453b8e89fbaff2906c9c4d7173a5439d86: Status 404 returned error can't find the container with id 495202f510ad211ea32e169e2c088c453b8e89fbaff2906c9c4d7173a5439d86
Aug 04 00:08:34.979607 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:34.979564    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf" event={"ID":"044a1248-d03f-4909-96b4-637aee3a2ebf","Type":"ContainerStarted","Data":"495202f510ad211ea32e169e2c088c453b8e89fbaff2906c9c4d7173a5439d86"}
Aug 04 00:08:34.981255 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:34.981234    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wv55h"]
Aug 04 00:08:34.986011 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:34.985986    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv55h"
Aug 04 00:08:34.988484 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:34.988462    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Aug 04 00:08:34.988623 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:34.988525    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-mqpwb\""
Aug 04 00:08:34.998152 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:34.998123    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wv55h"]
Aug 04 00:08:35.000941 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.000915    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-87768"]
Aug 04 00:08:35.004155 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.004131    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-87768"
Aug 04 00:08:35.006652 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.006631    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Aug 04 00:08:35.006783 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.006753    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-4tls9\""
Aug 04 00:08:35.022872 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.021855    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-87768"]
Aug 04 00:08:35.084216 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.084175    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btd5n\" (UniqueName: \"kubernetes.io/projected/0879b03f-6e77-4f5f-8a8a-8a07eb1c922d-kube-api-access-btd5n\") pod \"llmisvc-controller-manager-777c6bd7d5-87768\" (UID: \"0879b03f-6e77-4f5f-8a8a-8a07eb1c922d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-87768"
Aug 04 00:08:35.084388 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.084242    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gc9q\" (UniqueName: \"kubernetes.io/projected/d9eb0425-3fc2-42b2-89f4-edc38c47f37c-kube-api-access-7gc9q\") pod \"kserve-controller-manager-d6f4b65b8-wv55h\" (UID: \"d9eb0425-3fc2-42b2-89f4-edc38c47f37c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv55h"
Aug 04 00:08:35.084388 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.084360    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0879b03f-6e77-4f5f-8a8a-8a07eb1c922d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-87768\" (UID: \"0879b03f-6e77-4f5f-8a8a-8a07eb1c922d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-87768"
Aug 04 00:08:35.084465 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.084400    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9eb0425-3fc2-42b2-89f4-edc38c47f37c-cert\") pod \"kserve-controller-manager-d6f4b65b8-wv55h\" (UID: \"d9eb0425-3fc2-42b2-89f4-edc38c47f37c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv55h"
Aug 04 00:08:35.185313 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.185270    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btd5n\" (UniqueName: \"kubernetes.io/projected/0879b03f-6e77-4f5f-8a8a-8a07eb1c922d-kube-api-access-btd5n\") pod \"llmisvc-controller-manager-777c6bd7d5-87768\" (UID: \"0879b03f-6e77-4f5f-8a8a-8a07eb1c922d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-87768"
Aug 04 00:08:35.185510 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.185352    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gc9q\" (UniqueName: \"kubernetes.io/projected/d9eb0425-3fc2-42b2-89f4-edc38c47f37c-kube-api-access-7gc9q\") pod \"kserve-controller-manager-d6f4b65b8-wv55h\" (UID: \"d9eb0425-3fc2-42b2-89f4-edc38c47f37c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv55h"
Aug 04 00:08:35.185510 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.185425    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0879b03f-6e77-4f5f-8a8a-8a07eb1c922d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-87768\" (UID: \"0879b03f-6e77-4f5f-8a8a-8a07eb1c922d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-87768"
Aug 04 00:08:35.185510 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.185453    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9eb0425-3fc2-42b2-89f4-edc38c47f37c-cert\") pod \"kserve-controller-manager-d6f4b65b8-wv55h\" (UID: \"d9eb0425-3fc2-42b2-89f4-edc38c47f37c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv55h"
Aug 04 00:08:35.186009 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:08:35.185781    2556 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Aug 04 00:08:35.186009 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:08:35.185854    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0879b03f-6e77-4f5f-8a8a-8a07eb1c922d-cert podName:0879b03f-6e77-4f5f-8a8a-8a07eb1c922d nodeName:}" failed. No retries permitted until 2026-08-04 00:08:35.685832966 +0000 UTC m=+369.854470331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0879b03f-6e77-4f5f-8a8a-8a07eb1c922d-cert") pod "llmisvc-controller-manager-777c6bd7d5-87768" (UID: "0879b03f-6e77-4f5f-8a8a-8a07eb1c922d") : secret "llmisvc-webhook-server-cert" not found
Aug 04 00:08:35.186009 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:08:35.185784    2556 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Aug 04 00:08:35.186009 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:08:35.185938    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9eb0425-3fc2-42b2-89f4-edc38c47f37c-cert podName:d9eb0425-3fc2-42b2-89f4-edc38c47f37c nodeName:}" failed. No retries permitted until 2026-08-04 00:08:35.685924329 +0000 UTC m=+369.854561686 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d9eb0425-3fc2-42b2-89f4-edc38c47f37c-cert") pod "kserve-controller-manager-d6f4b65b8-wv55h" (UID: "d9eb0425-3fc2-42b2-89f4-edc38c47f37c") : secret "kserve-webhook-server-cert" not found
Aug 04 00:08:35.196414 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.196379    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gc9q\" (UniqueName: \"kubernetes.io/projected/d9eb0425-3fc2-42b2-89f4-edc38c47f37c-kube-api-access-7gc9q\") pod \"kserve-controller-manager-d6f4b65b8-wv55h\" (UID: \"d9eb0425-3fc2-42b2-89f4-edc38c47f37c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv55h"
Aug 04 00:08:35.196562 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.196532    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btd5n\" (UniqueName: \"kubernetes.io/projected/0879b03f-6e77-4f5f-8a8a-8a07eb1c922d-kube-api-access-btd5n\") pod \"llmisvc-controller-manager-777c6bd7d5-87768\" (UID: \"0879b03f-6e77-4f5f-8a8a-8a07eb1c922d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-87768"
Aug 04 00:08:35.690076 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.690035    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0879b03f-6e77-4f5f-8a8a-8a07eb1c922d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-87768\" (UID: \"0879b03f-6e77-4f5f-8a8a-8a07eb1c922d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-87768"
Aug 04 00:08:35.690076 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.690077    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9eb0425-3fc2-42b2-89f4-edc38c47f37c-cert\") pod \"kserve-controller-manager-d6f4b65b8-wv55h\" (UID: \"d9eb0425-3fc2-42b2-89f4-edc38c47f37c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv55h"
Aug 04 00:08:35.692544 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.692514    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9eb0425-3fc2-42b2-89f4-edc38c47f37c-cert\") pod \"kserve-controller-manager-d6f4b65b8-wv55h\" (UID: \"d9eb0425-3fc2-42b2-89f4-edc38c47f37c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv55h"
Aug 04 00:08:35.692654 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.692518    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0879b03f-6e77-4f5f-8a8a-8a07eb1c922d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-87768\" (UID: \"0879b03f-6e77-4f5f-8a8a-8a07eb1c922d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-87768"
Aug 04 00:08:35.797631 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.797594    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-b745d77d5-rqlkq"]
Aug 04 00:08:35.801262 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.801239    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b745d77d5-rqlkq"
Aug 04 00:08:35.804655 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.804632    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Aug 04 00:08:35.804799 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.804631    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cdkzt\""
Aug 04 00:08:35.804799 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.804632    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Aug 04 00:08:35.804958 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.804945    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Aug 04 00:08:35.805021 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.804967    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Aug 04 00:08:35.805021 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.804985    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Aug 04 00:08:35.810912 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.810887    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b745d77d5-rqlkq"]
Aug 04 00:08:35.892816 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.892773    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f3147fa-fab4-413c-8fcd-f1b180d40096-cert\") pod \"lws-controller-manager-b745d77d5-rqlkq\" (UID: \"8f3147fa-fab4-413c-8fcd-f1b180d40096\") " pod="openshift-lws-operator/lws-controller-manager-b745d77d5-rqlkq"
Aug 04 00:08:35.892816 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.892810    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f3147fa-fab4-413c-8fcd-f1b180d40096-metrics-cert\") pod \"lws-controller-manager-b745d77d5-rqlkq\" (UID: \"8f3147fa-fab4-413c-8fcd-f1b180d40096\") " pod="openshift-lws-operator/lws-controller-manager-b745d77d5-rqlkq"
Aug 04 00:08:35.893074 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.892911    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8f3147fa-fab4-413c-8fcd-f1b180d40096-manager-config\") pod \"lws-controller-manager-b745d77d5-rqlkq\" (UID: \"8f3147fa-fab4-413c-8fcd-f1b180d40096\") " pod="openshift-lws-operator/lws-controller-manager-b745d77d5-rqlkq"
Aug 04 00:08:35.893074 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.892935    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28js7\" (UniqueName: \"kubernetes.io/projected/8f3147fa-fab4-413c-8fcd-f1b180d40096-kube-api-access-28js7\") pod \"lws-controller-manager-b745d77d5-rqlkq\" (UID: \"8f3147fa-fab4-413c-8fcd-f1b180d40096\") " pod="openshift-lws-operator/lws-controller-manager-b745d77d5-rqlkq"
Aug 04 00:08:35.896611 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.896585    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv55h"
Aug 04 00:08:35.914599 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.914572    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-87768"
Aug 04 00:08:35.993879 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.993450    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8f3147fa-fab4-413c-8fcd-f1b180d40096-manager-config\") pod \"lws-controller-manager-b745d77d5-rqlkq\" (UID: \"8f3147fa-fab4-413c-8fcd-f1b180d40096\") " pod="openshift-lws-operator/lws-controller-manager-b745d77d5-rqlkq"
Aug 04 00:08:35.993879 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.993504    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28js7\" (UniqueName: \"kubernetes.io/projected/8f3147fa-fab4-413c-8fcd-f1b180d40096-kube-api-access-28js7\") pod \"lws-controller-manager-b745d77d5-rqlkq\" (UID: \"8f3147fa-fab4-413c-8fcd-f1b180d40096\") " pod="openshift-lws-operator/lws-controller-manager-b745d77d5-rqlkq"
Aug 04 00:08:35.993879 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.993628    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f3147fa-fab4-413c-8fcd-f1b180d40096-cert\") pod \"lws-controller-manager-b745d77d5-rqlkq\" (UID: \"8f3147fa-fab4-413c-8fcd-f1b180d40096\") " pod="openshift-lws-operator/lws-controller-manager-b745d77d5-rqlkq"
Aug 04 00:08:35.993879 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.993657    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f3147fa-fab4-413c-8fcd-f1b180d40096-metrics-cert\") pod \"lws-controller-manager-b745d77d5-rqlkq\" (UID: \"8f3147fa-fab4-413c-8fcd-f1b180d40096\") " pod="openshift-lws-operator/lws-controller-manager-b745d77d5-rqlkq"
Aug 04 00:08:35.994949 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:35.994606    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8f3147fa-fab4-413c-8fcd-f1b180d40096-manager-config\") pod \"lws-controller-manager-b745d77d5-rqlkq\" (UID: \"8f3147fa-fab4-413c-8fcd-f1b180d40096\") " pod="openshift-lws-operator/lws-controller-manager-b745d77d5-rqlkq"
Aug 04 00:08:36.004284 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:36.003767    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f3147fa-fab4-413c-8fcd-f1b180d40096-cert\") pod \"lws-controller-manager-b745d77d5-rqlkq\" (UID: \"8f3147fa-fab4-413c-8fcd-f1b180d40096\") " pod="openshift-lws-operator/lws-controller-manager-b745d77d5-rqlkq"
Aug 04 00:08:36.004437 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:36.004350    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f3147fa-fab4-413c-8fcd-f1b180d40096-metrics-cert\") pod \"lws-controller-manager-b745d77d5-rqlkq\" (UID: \"8f3147fa-fab4-413c-8fcd-f1b180d40096\") " pod="openshift-lws-operator/lws-controller-manager-b745d77d5-rqlkq"
Aug 04 00:08:36.015385 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:36.013006    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28js7\" (UniqueName: \"kubernetes.io/projected/8f3147fa-fab4-413c-8fcd-f1b180d40096-kube-api-access-28js7\") pod \"lws-controller-manager-b745d77d5-rqlkq\" (UID: \"8f3147fa-fab4-413c-8fcd-f1b180d40096\") " pod="openshift-lws-operator/lws-controller-manager-b745d77d5-rqlkq"
Aug 04 00:08:36.075759 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:36.074839    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wv55h"]
Aug 04 00:08:36.077991 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:08:36.077733    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9eb0425_3fc2_42b2_89f4_edc38c47f37c.slice/crio-425cb44692b3795f689069742148a041d6912b9bf32ed295e45a9e21b28089d6 WatchSource:0}: Error finding container 425cb44692b3795f689069742148a041d6912b9bf32ed295e45a9e21b28089d6: Status 404 returned error can't find the container with id 425cb44692b3795f689069742148a041d6912b9bf32ed295e45a9e21b28089d6
Aug 04 00:08:36.101545 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:36.100661    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-87768"]
Aug 04 00:08:36.106492 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:08:36.106464    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0879b03f_6e77_4f5f_8a8a_8a07eb1c922d.slice/crio-32041e4fd801f515c78f7d202efe74fa41b1d8bf6267135e41ee79f9a1144214 WatchSource:0}: Error finding container 32041e4fd801f515c78f7d202efe74fa41b1d8bf6267135e41ee79f9a1144214: Status 404 returned error can't find the container with id 32041e4fd801f515c78f7d202efe74fa41b1d8bf6267135e41ee79f9a1144214
Aug 04 00:08:36.111978 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:36.111951    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b745d77d5-rqlkq"
Aug 04 00:08:36.313759 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:08:36.313729    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f3147fa_fab4_413c_8fcd_f1b180d40096.slice/crio-5829c22a02eca0f8b80d5dd617536140d97781e2af2ffe8a4140610ae4a6d9df WatchSource:0}: Error finding container 5829c22a02eca0f8b80d5dd617536140d97781e2af2ffe8a4140610ae4a6d9df: Status 404 returned error can't find the container with id 5829c22a02eca0f8b80d5dd617536140d97781e2af2ffe8a4140610ae4a6d9df
Aug 04 00:08:36.313934 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:36.313874    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b745d77d5-rqlkq"]
Aug 04 00:08:36.995497 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:36.995441    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b745d77d5-rqlkq" event={"ID":"8f3147fa-fab4-413c-8fcd-f1b180d40096","Type":"ContainerStarted","Data":"5829c22a02eca0f8b80d5dd617536140d97781e2af2ffe8a4140610ae4a6d9df"}
Aug 04 00:08:36.997209 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:36.997173    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-87768" event={"ID":"0879b03f-6e77-4f5f-8a8a-8a07eb1c922d","Type":"ContainerStarted","Data":"32041e4fd801f515c78f7d202efe74fa41b1d8bf6267135e41ee79f9a1144214"}
Aug 04 00:08:36.998673 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:36.998647    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv55h" event={"ID":"d9eb0425-3fc2-42b2-89f4-edc38c47f37c","Type":"ContainerStarted","Data":"425cb44692b3795f689069742148a041d6912b9bf32ed295e45a9e21b28089d6"}
Aug 04 00:08:38.283413 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:38.283355    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:08:38.283911 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:38.283468    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:08:38.283911 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:38.283513    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:08:42.027555 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:42.027517    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv55h" event={"ID":"d9eb0425-3fc2-42b2-89f4-edc38c47f37c","Type":"ContainerStarted","Data":"c50c62ee0d81a25339d9a3af9a32d2385e6841705b18ba90b525be9e8a9b21a9"}
Aug 04 00:08:42.028102 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:42.027609    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv55h"
Aug 04 00:08:42.028980 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:42.028959    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b745d77d5-rqlkq" event={"ID":"8f3147fa-fab4-413c-8fcd-f1b180d40096","Type":"ContainerStarted","Data":"6b7d1bcce4a5cc07aa8457963b28aa79809c817a1e955a552960408686aacb8c"}
Aug 04 00:08:42.029080 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:42.029053    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-b745d77d5-rqlkq"
Aug 04 00:08:42.030472 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:42.030447    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-87768" event={"ID":"0879b03f-6e77-4f5f-8a8a-8a07eb1c922d","Type":"ContainerStarted","Data":"e3ba30c4c5b2cbcc5fca168cff4bbb2689732d9b2ffff0a65132b1b7d7506b8f"}
Aug 04 00:08:42.030603 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:42.030498    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-87768"
Aug 04 00:08:42.032074 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:42.032050    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf" event={"ID":"044a1248-d03f-4909-96b4-637aee3a2ebf","Type":"ContainerStarted","Data":"232ab47876bb6e79507bc013159b4054c3fcfbb5002d13b7640787efc1aaa769"}
Aug 04 00:08:42.046873 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:42.046819    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv55h" podStartSLOduration=3.344964946 podStartE2EDuration="8.046799434s" totalImagesPullingTime="4.701834488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:08:42.045394102 +0000 UTC m=+376.214031473" watchObservedRunningTime="2026-08-04 00:08:42.046799434 +0000 UTC m=+376.215436807"
Aug 04 00:08:42.061483 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:42.061437    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-b745d77d5-rqlkq" podStartSLOduration=2.595961524 podStartE2EDuration="7.061421704s" totalImagesPullingTime="4.46546018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:08:42.060151864 +0000 UTC m=+376.228789232" watchObservedRunningTime="2026-08-04 00:08:42.061421704 +0000 UTC m=+376.230059072"
Aug 04 00:08:42.077315 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:42.077271    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-87768" podStartSLOduration=2.641477327 podStartE2EDuration="8.07725675s" totalImagesPullingTime="5.435779423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:08:42.076646253 +0000 UTC m=+376.245283622" watchObservedRunningTime="2026-08-04 00:08:42.07725675 +0000 UTC m=+376.245894118"
Aug 04 00:08:42.096129 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:42.096076    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf" podStartSLOduration=4.7982755489999995 podStartE2EDuration="9.096061443s" totalImagesPullingTime="4.297785894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:08:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:08:42.094833911 +0000 UTC m=+376.263471285" watchObservedRunningTime="2026-08-04 00:08:42.096061443 +0000 UTC m=+376.264698810"
Aug 04 00:08:42.831242 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:42.831203    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:42.836223 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:42.836198    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:43.037299 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:43.037268    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:43.038091 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:43.038075    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf"
Aug 04 00:08:53.039426 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:53.039394    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-b745d77d5-rqlkq"
Aug 04 00:08:58.045267 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:58.045224    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-58b56856cd-2pm9z" podUID="7e8da293-1075-47c9-ba1d-0bc6cf9350eb" containerName="console" containerID="cri-o://a7ea5ba7941515848286e100d5e78eac5b3f2893163e44772d6b4625d9b57014" gracePeriod=15
Aug 04 00:08:58.289251 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:58.289224    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:08:58.409172 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:58.409097    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-trusted-ca-bundle\") pod \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") "
Aug 04 00:08:58.409172 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:58.409137    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-oauth-serving-cert\") pod \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") "
Aug 04 00:08:58.409172 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:58.409170    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-console-config\") pod \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") "
Aug 04 00:08:58.409467 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:58.409191    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-console-serving-cert\") pod \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") "
Aug 04 00:08:58.409467 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:58.409225    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-service-ca\") pod \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") "
Aug 04 00:08:58.409467 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:58.409276    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-console-oauth-config\") pod \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") "
Aug 04 00:08:58.409467 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:58.409304    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n69rs\" (UniqueName: \"kubernetes.io/projected/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-kube-api-access-n69rs\") pod \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\" (UID: \"7e8da293-1075-47c9-ba1d-0bc6cf9350eb\") "
Aug 04 00:08:58.409754 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:58.409526    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7e8da293-1075-47c9-ba1d-0bc6cf9350eb" (UID: "7e8da293-1075-47c9-ba1d-0bc6cf9350eb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:08:58.409754 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:58.409637    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-console-config" (OuterVolumeSpecName: "console-config") pod "7e8da293-1075-47c9-ba1d-0bc6cf9350eb" (UID: "7e8da293-1075-47c9-ba1d-0bc6cf9350eb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:08:58.409754 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:58.409744    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-oauth-serving-cert\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:08:58.409912 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:58.409795    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7e8da293-1075-47c9-ba1d-0bc6cf9350eb" (UID: "7e8da293-1075-47c9-ba1d-0bc6cf9350eb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:08:58.410187 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:58.410161    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-service-ca" (OuterVolumeSpecName: "service-ca") pod "7e8da293-1075-47c9-ba1d-0bc6cf9350eb" (UID: "7e8da293-1075-47c9-ba1d-0bc6cf9350eb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:08:58.411529 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:58.411506    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7e8da293-1075-47c9-ba1d-0bc6cf9350eb" (UID: "7e8da293-1075-47c9-ba1d-0bc6cf9350eb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:08:58.411677 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:58.411653    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7e8da293-1075-47c9-ba1d-0bc6cf9350eb" (UID: "7e8da293-1075-47c9-ba1d-0bc6cf9350eb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:08:58.411752 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:58.411692    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-kube-api-access-n69rs" (OuterVolumeSpecName: "kube-api-access-n69rs") pod "7e8da293-1075-47c9-ba1d-0bc6cf9350eb" (UID: "7e8da293-1075-47c9-ba1d-0bc6cf9350eb"). InnerVolumeSpecName "kube-api-access-n69rs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:08:58.510796 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:58.510758    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-trusted-ca-bundle\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:08:58.510796 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:58.510785    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-console-config\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:08:58.510796 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:58.510796    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-console-serving-cert\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:08:58.510796 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:58.510805    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-service-ca\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:08:58.511055 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:58.510815    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-console-oauth-config\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:08:58.511055 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:58.510823    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n69rs\" (UniqueName: \"kubernetes.io/projected/7e8da293-1075-47c9-ba1d-0bc6cf9350eb-kube-api-access-n69rs\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:08:59.115946 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:59.115911    2556 generic.go:356] "Generic (PLEG): container finished" podID="7e8da293-1075-47c9-ba1d-0bc6cf9350eb" containerID="a7ea5ba7941515848286e100d5e78eac5b3f2893163e44772d6b4625d9b57014" exitCode=0
Aug 04 00:08:59.116340 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:59.115946    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58b56856cd-2pm9z" event={"ID":"7e8da293-1075-47c9-ba1d-0bc6cf9350eb","Type":"ContainerDied","Data":"a7ea5ba7941515848286e100d5e78eac5b3f2893163e44772d6b4625d9b57014"}
Aug 04 00:08:59.116340 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:59.115976    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58b56856cd-2pm9z"
Aug 04 00:08:59.116340 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:59.116010    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58b56856cd-2pm9z" event={"ID":"7e8da293-1075-47c9-ba1d-0bc6cf9350eb","Type":"ContainerDied","Data":"484d2b1da30d702e5e00eb314e0e0f2beb866d3088c8448a7a9a0b7165769784"}
Aug 04 00:08:59.116340 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:59.116040    2556 scope.go:117] "RemoveContainer" containerID="a7ea5ba7941515848286e100d5e78eac5b3f2893163e44772d6b4625d9b57014"
Aug 04 00:08:59.125127 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:59.125114    2556 scope.go:117] "RemoveContainer" containerID="a7ea5ba7941515848286e100d5e78eac5b3f2893163e44772d6b4625d9b57014"
Aug 04 00:08:59.125370 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:08:59.125351    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7ea5ba7941515848286e100d5e78eac5b3f2893163e44772d6b4625d9b57014\": container with ID starting with a7ea5ba7941515848286e100d5e78eac5b3f2893163e44772d6b4625d9b57014 not found: ID does not exist" containerID="a7ea5ba7941515848286e100d5e78eac5b3f2893163e44772d6b4625d9b57014"
Aug 04 00:08:59.125427 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:59.125377    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7ea5ba7941515848286e100d5e78eac5b3f2893163e44772d6b4625d9b57014"} err="failed to get container status \"a7ea5ba7941515848286e100d5e78eac5b3f2893163e44772d6b4625d9b57014\": rpc error: code = NotFound desc = could not find container \"a7ea5ba7941515848286e100d5e78eac5b3f2893163e44772d6b4625d9b57014\": container with ID starting with a7ea5ba7941515848286e100d5e78eac5b3f2893163e44772d6b4625d9b57014 not found: ID does not exist"
Aug 04 00:08:59.137442 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:59.137415    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58b56856cd-2pm9z"]
Aug 04 00:08:59.141749 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:08:59.141726    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58b56856cd-2pm9z"]
Aug 04 00:09:00.307151 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:09:00.307119    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e8da293-1075-47c9-ba1d-0bc6cf9350eb" path="/var/lib/kubelet/pods/7e8da293-1075-47c9-ba1d-0bc6cf9350eb/volumes"
Aug 04 00:09:13.038972 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:09:13.038936    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-87768"
Aug 04 00:09:13.042063 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:09:13.042045    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wv55h"
Aug 04 00:10:47.753287 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:47.753240    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-jv5dr"]
Aug 04 00:10:47.753910 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:47.753797    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e8da293-1075-47c9-ba1d-0bc6cf9350eb" containerName="console"
Aug 04 00:10:47.753910 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:47.753818    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e8da293-1075-47c9-ba1d-0bc6cf9350eb" containerName="console"
Aug 04 00:10:47.754026 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:47.753941    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e8da293-1075-47c9-ba1d-0bc6cf9350eb" containerName="console"
Aug 04 00:10:47.756922 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:47.756907    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-jv5dr"
Aug 04 00:10:47.759642 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:47.759620    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 04 00:10:47.760528 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:47.760510    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 04 00:10:47.760629 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:47.760529    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7jlmt\""
Aug 04 00:10:47.765812 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:47.765788    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-jv5dr"]
Aug 04 00:10:47.797397 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:47.797362    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tljzl\" (UniqueName: \"kubernetes.io/projected/24295ecf-5628-4a8f-81bc-b01dd8e2cf72-kube-api-access-tljzl\") pod \"authorino-b54df94b4-jv5dr\" (UID: \"24295ecf-5628-4a8f-81bc-b01dd8e2cf72\") " pod="kuadrant-system/authorino-b54df94b4-jv5dr"
Aug 04 00:10:47.898131 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:47.898092    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tljzl\" (UniqueName: \"kubernetes.io/projected/24295ecf-5628-4a8f-81bc-b01dd8e2cf72-kube-api-access-tljzl\") pod \"authorino-b54df94b4-jv5dr\" (UID: \"24295ecf-5628-4a8f-81bc-b01dd8e2cf72\") " pod="kuadrant-system/authorino-b54df94b4-jv5dr"
Aug 04 00:10:47.909931 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:47.909896    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tljzl\" (UniqueName: \"kubernetes.io/projected/24295ecf-5628-4a8f-81bc-b01dd8e2cf72-kube-api-access-tljzl\") pod \"authorino-b54df94b4-jv5dr\" (UID: \"24295ecf-5628-4a8f-81bc-b01dd8e2cf72\") " pod="kuadrant-system/authorino-b54df94b4-jv5dr"
Aug 04 00:10:48.067005 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:48.066919    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-jv5dr"
Aug 04 00:10:48.199985 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:48.199953    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-jv5dr"]
Aug 04 00:10:48.202396 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:10:48.202369    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24295ecf_5628_4a8f_81bc_b01dd8e2cf72.slice/crio-80667ca145d2d95eccae0ad1f317ff56f67d67252244460ae7a1cc4a6390e1b6 WatchSource:0}: Error finding container 80667ca145d2d95eccae0ad1f317ff56f67d67252244460ae7a1cc4a6390e1b6: Status 404 returned error can't find the container with id 80667ca145d2d95eccae0ad1f317ff56f67d67252244460ae7a1cc4a6390e1b6
Aug 04 00:10:48.637228 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:48.637191    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-jv5dr" event={"ID":"24295ecf-5628-4a8f-81bc-b01dd8e2cf72","Type":"ContainerStarted","Data":"80667ca145d2d95eccae0ad1f317ff56f67d67252244460ae7a1cc4a6390e1b6"}
Aug 04 00:10:51.654057 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:51.653952    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-jv5dr" event={"ID":"24295ecf-5628-4a8f-81bc-b01dd8e2cf72","Type":"ContainerStarted","Data":"196f8fe2534ba742895ca5f5357f2942c69c4d056ba51688c2bea356395ee09a"}
Aug 04 00:10:51.669163 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:51.669113    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-jv5dr" podStartSLOduration=1.552779978 podStartE2EDuration="4.669098337s" totalImagesPullingTime="3.116318359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:10:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:10:51.667684919 +0000 UTC m=+505.836322290" watchObservedRunningTime="2026-08-04 00:10:51.669098337 +0000 UTC m=+505.837735740"
Aug 04 00:10:51.966135 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:51.966052    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-jv5dr"]
Aug 04 00:10:53.663836 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:53.663774    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-jv5dr" podUID="24295ecf-5628-4a8f-81bc-b01dd8e2cf72" containerName="authorino" containerID="cri-o://196f8fe2534ba742895ca5f5357f2942c69c4d056ba51688c2bea356395ee09a" gracePeriod=30
Aug 04 00:10:53.911105 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:53.911075    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-jv5dr"
Aug 04 00:10:54.056046 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:54.056007    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tljzl\" (UniqueName: \"kubernetes.io/projected/24295ecf-5628-4a8f-81bc-b01dd8e2cf72-kube-api-access-tljzl\") pod \"24295ecf-5628-4a8f-81bc-b01dd8e2cf72\" (UID: \"24295ecf-5628-4a8f-81bc-b01dd8e2cf72\") "
Aug 04 00:10:54.058212 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:54.058183    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24295ecf-5628-4a8f-81bc-b01dd8e2cf72-kube-api-access-tljzl" (OuterVolumeSpecName: "kube-api-access-tljzl") pod "24295ecf-5628-4a8f-81bc-b01dd8e2cf72" (UID: "24295ecf-5628-4a8f-81bc-b01dd8e2cf72"). InnerVolumeSpecName "kube-api-access-tljzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:10:54.156919 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:54.156882    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tljzl\" (UniqueName: \"kubernetes.io/projected/24295ecf-5628-4a8f-81bc-b01dd8e2cf72-kube-api-access-tljzl\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:10:54.669638 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:54.669549    2556 generic.go:356] "Generic (PLEG): container finished" podID="24295ecf-5628-4a8f-81bc-b01dd8e2cf72" containerID="196f8fe2534ba742895ca5f5357f2942c69c4d056ba51688c2bea356395ee09a" exitCode=0
Aug 04 00:10:54.669638 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:54.669594    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-jv5dr"
Aug 04 00:10:54.669638 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:54.669604    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-jv5dr" event={"ID":"24295ecf-5628-4a8f-81bc-b01dd8e2cf72","Type":"ContainerDied","Data":"196f8fe2534ba742895ca5f5357f2942c69c4d056ba51688c2bea356395ee09a"}
Aug 04 00:10:54.670179 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:54.669644    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-jv5dr" event={"ID":"24295ecf-5628-4a8f-81bc-b01dd8e2cf72","Type":"ContainerDied","Data":"80667ca145d2d95eccae0ad1f317ff56f67d67252244460ae7a1cc4a6390e1b6"}
Aug 04 00:10:54.670179 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:54.669666    2556 scope.go:117] "RemoveContainer" containerID="196f8fe2534ba742895ca5f5357f2942c69c4d056ba51688c2bea356395ee09a"
Aug 04 00:10:54.678188 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:54.678168    2556 scope.go:117] "RemoveContainer" containerID="196f8fe2534ba742895ca5f5357f2942c69c4d056ba51688c2bea356395ee09a"
Aug 04 00:10:54.678489 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:10:54.678456    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"196f8fe2534ba742895ca5f5357f2942c69c4d056ba51688c2bea356395ee09a\": container with ID starting with 196f8fe2534ba742895ca5f5357f2942c69c4d056ba51688c2bea356395ee09a not found: ID does not exist" containerID="196f8fe2534ba742895ca5f5357f2942c69c4d056ba51688c2bea356395ee09a"
Aug 04 00:10:54.678561 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:54.678500    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"196f8fe2534ba742895ca5f5357f2942c69c4d056ba51688c2bea356395ee09a"} err="failed to get container status \"196f8fe2534ba742895ca5f5357f2942c69c4d056ba51688c2bea356395ee09a\": rpc error: code = NotFound desc = could not find container \"196f8fe2534ba742895ca5f5357f2942c69c4d056ba51688c2bea356395ee09a\": container with ID starting with 196f8fe2534ba742895ca5f5357f2942c69c4d056ba51688c2bea356395ee09a not found: ID does not exist"
Aug 04 00:10:54.686320 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:54.686292    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-jv5dr"]
Aug 04 00:10:54.687818 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:54.687799    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-jv5dr"]
Aug 04 00:10:56.307038 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:10:56.307006    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24295ecf-5628-4a8f-81bc-b01dd8e2cf72" path="/var/lib/kubelet/pods/24295ecf-5628-4a8f-81bc-b01dd8e2cf72/volumes"
Aug 04 00:11:03.557559 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:03.557528    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fxk6z"]
Aug 04 00:11:03.557957 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:03.557934    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24295ecf-5628-4a8f-81bc-b01dd8e2cf72" containerName="authorino"
Aug 04 00:11:03.557957 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:03.557947    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="24295ecf-5628-4a8f-81bc-b01dd8e2cf72" containerName="authorino"
Aug 04 00:11:03.558036 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:03.558015    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="24295ecf-5628-4a8f-81bc-b01dd8e2cf72" containerName="authorino"
Aug 04 00:11:03.562954 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:03.562931    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fxk6z"
Aug 04 00:11:03.565374 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:03.565354    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Aug 04 00:11:03.566474 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:03.566439    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 04 00:11:03.566589 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:03.566469    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 00:11:03.566757 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:03.566737    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-ffpdr\""
Aug 04 00:11:03.580331 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:03.579738    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fxk6z"]
Aug 04 00:11:03.747017 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:03.746933    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a6a564c2-249b-48c1-bdab-cefc1ca2b2cf-data\") pod \"postgres-69fb4594cf-fxk6z\" (UID: \"a6a564c2-249b-48c1-bdab-cefc1ca2b2cf\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fxk6z"
Aug 04 00:11:03.747017 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:03.747003    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh2tz\" (UniqueName: \"kubernetes.io/projected/a6a564c2-249b-48c1-bdab-cefc1ca2b2cf-kube-api-access-bh2tz\") pod \"postgres-69fb4594cf-fxk6z\" (UID: \"a6a564c2-249b-48c1-bdab-cefc1ca2b2cf\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fxk6z"
Aug 04 00:11:03.848416 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:03.848384    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh2tz\" (UniqueName: \"kubernetes.io/projected/a6a564c2-249b-48c1-bdab-cefc1ca2b2cf-kube-api-access-bh2tz\") pod \"postgres-69fb4594cf-fxk6z\" (UID: \"a6a564c2-249b-48c1-bdab-cefc1ca2b2cf\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fxk6z"
Aug 04 00:11:03.848576 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:03.848545    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a6a564c2-249b-48c1-bdab-cefc1ca2b2cf-data\") pod \"postgres-69fb4594cf-fxk6z\" (UID: \"a6a564c2-249b-48c1-bdab-cefc1ca2b2cf\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fxk6z"
Aug 04 00:11:03.848910 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:03.848894    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a6a564c2-249b-48c1-bdab-cefc1ca2b2cf-data\") pod \"postgres-69fb4594cf-fxk6z\" (UID: \"a6a564c2-249b-48c1-bdab-cefc1ca2b2cf\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fxk6z"
Aug 04 00:11:03.856527 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:03.856499    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh2tz\" (UniqueName: \"kubernetes.io/projected/a6a564c2-249b-48c1-bdab-cefc1ca2b2cf-kube-api-access-bh2tz\") pod \"postgres-69fb4594cf-fxk6z\" (UID: \"a6a564c2-249b-48c1-bdab-cefc1ca2b2cf\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fxk6z"
Aug 04 00:11:03.881432 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:03.881410    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fxk6z"
Aug 04 00:11:04.014300 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:04.014267    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fxk6z"]
Aug 04 00:11:04.024786 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:11:04.024748    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6a564c2_249b_48c1_bdab_cefc1ca2b2cf.slice/crio-59ad01c3f784a97ad3ab6f649d0b8918186b8ea8c64038a9b77b32cc9966549f WatchSource:0}: Error finding container 59ad01c3f784a97ad3ab6f649d0b8918186b8ea8c64038a9b77b32cc9966549f: Status 404 returned error can't find the container with id 59ad01c3f784a97ad3ab6f649d0b8918186b8ea8c64038a9b77b32cc9966549f
Aug 04 00:11:04.719658 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:04.719626    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fxk6z" event={"ID":"a6a564c2-249b-48c1-bdab-cefc1ca2b2cf","Type":"ContainerStarted","Data":"59ad01c3f784a97ad3ab6f649d0b8918186b8ea8c64038a9b77b32cc9966549f"}
Aug 04 00:11:09.749202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:09.749166    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fxk6z" event={"ID":"a6a564c2-249b-48c1-bdab-cefc1ca2b2cf","Type":"ContainerStarted","Data":"6c8616e89d64de45a01beb08eabc9a32b50239a3a841ea209b700507ca60111e"}
Aug 04 00:11:09.749568 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:09.749283    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fxk6z"
Aug 04 00:11:09.764916 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:09.764862    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fxk6z" podStartSLOduration=1.74381965 podStartE2EDuration="6.764844559s" totalImagesPullingTime="5.021024909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:11:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:11:09.763924454 +0000 UTC m=+523.932561845" watchObservedRunningTime="2026-08-04 00:11:09.764844559 +0000 UTC m=+523.933481928"
Aug 04 00:11:15.783267 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:15.783236    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fxk6z"
Aug 04 00:11:16.363152 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.363116    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-cbpr4"]
Aug 04 00:11:16.366944 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.366917    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-cbpr4"
Aug 04 00:11:16.369467 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.369443    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7jlmt\""
Aug 04 00:11:16.369622 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.369493    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 04 00:11:16.369622 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.369494    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 04 00:11:16.376421 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.376398    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-cbpr4"]
Aug 04 00:11:16.449219 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.449182    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-cbpr4"]
Aug 04 00:11:16.449506 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:11:16.449485    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-zhq8q], unattached volumes=[], failed to process volumes=[kube-api-access-zhq8q]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-cbpr4" podUID="0d1578c8-8610-4a23-bdc4-8b8f383471b3"
Aug 04 00:11:16.454359 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.454338    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhq8q\" (UniqueName: \"kubernetes.io/projected/0d1578c8-8610-4a23-bdc4-8b8f383471b3-kube-api-access-zhq8q\") pod \"authorino-5dc7ccb5f-cbpr4\" (UID: \"0d1578c8-8610-4a23-bdc4-8b8f383471b3\") " pod="kuadrant-system/authorino-5dc7ccb5f-cbpr4"
Aug 04 00:11:16.478531 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.478499    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687bd45585-zkrdv"]
Aug 04 00:11:16.482077 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.482059    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-zkrdv"
Aug 04 00:11:16.484781 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.484761    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Aug 04 00:11:16.489286 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.489263    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687bd45585-zkrdv"]
Aug 04 00:11:16.555644 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.555609    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhq8q\" (UniqueName: \"kubernetes.io/projected/0d1578c8-8610-4a23-bdc4-8b8f383471b3-kube-api-access-zhq8q\") pod \"authorino-5dc7ccb5f-cbpr4\" (UID: \"0d1578c8-8610-4a23-bdc4-8b8f383471b3\") " pod="kuadrant-system/authorino-5dc7ccb5f-cbpr4"
Aug 04 00:11:16.555872 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.555681    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw772\" (UniqueName: \"kubernetes.io/projected/d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55-kube-api-access-qw772\") pod \"authorino-687bd45585-zkrdv\" (UID: \"d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55\") " pod="kuadrant-system/authorino-687bd45585-zkrdv"
Aug 04 00:11:16.555872 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.555796    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55-tls-cert\") pod \"authorino-687bd45585-zkrdv\" (UID: \"d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55\") " pod="kuadrant-system/authorino-687bd45585-zkrdv"
Aug 04 00:11:16.565044 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.565017    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhq8q\" (UniqueName: \"kubernetes.io/projected/0d1578c8-8610-4a23-bdc4-8b8f383471b3-kube-api-access-zhq8q\") pod \"authorino-5dc7ccb5f-cbpr4\" (UID: \"0d1578c8-8610-4a23-bdc4-8b8f383471b3\") " pod="kuadrant-system/authorino-5dc7ccb5f-cbpr4"
Aug 04 00:11:16.612980 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.612948    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-zkrdv"]
Aug 04 00:11:16.613286 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:11:16.613239    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qw772 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-687bd45585-zkrdv" podUID="d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55"
Aug 04 00:11:16.648420 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.648387    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6ff97d667-2wb7c"]
Aug 04 00:11:16.651740 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.651708    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6ff97d667-2wb7c"
Aug 04 00:11:16.656377 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.656353    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw772\" (UniqueName: \"kubernetes.io/projected/d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55-kube-api-access-qw772\") pod \"authorino-687bd45585-zkrdv\" (UID: \"d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55\") " pod="kuadrant-system/authorino-687bd45585-zkrdv"
Aug 04 00:11:16.656463 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.656446    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55-tls-cert\") pod \"authorino-687bd45585-zkrdv\" (UID: \"d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55\") " pod="kuadrant-system/authorino-687bd45585-zkrdv"
Aug 04 00:11:16.656504 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.656490    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/70939b25-9187-42fd-aed4-c9bafadd4e62-tls-cert\") pod \"authorino-6ff97d667-2wb7c\" (UID: \"70939b25-9187-42fd-aed4-c9bafadd4e62\") " pod="kuadrant-system/authorino-6ff97d667-2wb7c"
Aug 04 00:11:16.656768 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.656546    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h7ls\" (UniqueName: \"kubernetes.io/projected/70939b25-9187-42fd-aed4-c9bafadd4e62-kube-api-access-6h7ls\") pod \"authorino-6ff97d667-2wb7c\" (UID: \"70939b25-9187-42fd-aed4-c9bafadd4e62\") " pod="kuadrant-system/authorino-6ff97d667-2wb7c"
Aug 04 00:11:16.659919 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.659898    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55-tls-cert\") pod \"authorino-687bd45585-zkrdv\" (UID: \"d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55\") " pod="kuadrant-system/authorino-687bd45585-zkrdv"
Aug 04 00:11:16.660250 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.660231    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6ff97d667-2wb7c"]
Aug 04 00:11:16.666611 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.666589    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw772\" (UniqueName: \"kubernetes.io/projected/d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55-kube-api-access-qw772\") pod \"authorino-687bd45585-zkrdv\" (UID: \"d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55\") " pod="kuadrant-system/authorino-687bd45585-zkrdv"
Aug 04 00:11:16.757671 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.757635    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/70939b25-9187-42fd-aed4-c9bafadd4e62-tls-cert\") pod \"authorino-6ff97d667-2wb7c\" (UID: \"70939b25-9187-42fd-aed4-c9bafadd4e62\") " pod="kuadrant-system/authorino-6ff97d667-2wb7c"
Aug 04 00:11:16.757901 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.757699    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h7ls\" (UniqueName: \"kubernetes.io/projected/70939b25-9187-42fd-aed4-c9bafadd4e62-kube-api-access-6h7ls\") pod \"authorino-6ff97d667-2wb7c\" (UID: \"70939b25-9187-42fd-aed4-c9bafadd4e62\") " pod="kuadrant-system/authorino-6ff97d667-2wb7c"
Aug 04 00:11:16.760038 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.760009    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/70939b25-9187-42fd-aed4-c9bafadd4e62-tls-cert\") pod \"authorino-6ff97d667-2wb7c\" (UID: \"70939b25-9187-42fd-aed4-c9bafadd4e62\") " pod="kuadrant-system/authorino-6ff97d667-2wb7c"
Aug 04 00:11:16.767388 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.767359    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h7ls\" (UniqueName: \"kubernetes.io/projected/70939b25-9187-42fd-aed4-c9bafadd4e62-kube-api-access-6h7ls\") pod \"authorino-6ff97d667-2wb7c\" (UID: \"70939b25-9187-42fd-aed4-c9bafadd4e62\") " pod="kuadrant-system/authorino-6ff97d667-2wb7c"
Aug 04 00:11:16.781889 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.781868    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-cbpr4"
Aug 04 00:11:16.782018 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.781868    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-zkrdv"
Aug 04 00:11:16.788881 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.788863    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-cbpr4"
Aug 04 00:11:16.791594 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.791578    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-zkrdv"
Aug 04 00:11:16.858523 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.858492    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55-tls-cert\") pod \"d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55\" (UID: \"d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55\") "
Aug 04 00:11:16.858704 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.858570    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhq8q\" (UniqueName: \"kubernetes.io/projected/0d1578c8-8610-4a23-bdc4-8b8f383471b3-kube-api-access-zhq8q\") pod \"0d1578c8-8610-4a23-bdc4-8b8f383471b3\" (UID: \"0d1578c8-8610-4a23-bdc4-8b8f383471b3\") "
Aug 04 00:11:16.858704 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.858615    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qw772\" (UniqueName: \"kubernetes.io/projected/d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55-kube-api-access-qw772\") pod \"d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55\" (UID: \"d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55\") "
Aug 04 00:11:16.860796 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.860762    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d1578c8-8610-4a23-bdc4-8b8f383471b3-kube-api-access-zhq8q" (OuterVolumeSpecName: "kube-api-access-zhq8q") pod "0d1578c8-8610-4a23-bdc4-8b8f383471b3" (UID: "0d1578c8-8610-4a23-bdc4-8b8f383471b3"). InnerVolumeSpecName "kube-api-access-zhq8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:11:16.860796 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.860778    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55-kube-api-access-qw772" (OuterVolumeSpecName: "kube-api-access-qw772") pod "d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55" (UID: "d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55"). InnerVolumeSpecName "kube-api-access-qw772". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:11:16.860796 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.860775    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55" (UID: "d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:11:16.959590 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.959499    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhq8q\" (UniqueName: \"kubernetes.io/projected/0d1578c8-8610-4a23-bdc4-8b8f383471b3-kube-api-access-zhq8q\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:11:16.959590 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.959529    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qw772\" (UniqueName: \"kubernetes.io/projected/d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55-kube-api-access-qw772\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:11:16.959590 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.959542    2556 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55-tls-cert\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:11:16.977387 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:16.977356    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6ff97d667-2wb7c"
Aug 04 00:11:17.141916 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:17.141880    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6ff97d667-2wb7c"]
Aug 04 00:11:17.145124 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:11:17.145097    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70939b25_9187_42fd_aed4_c9bafadd4e62.slice/crio-4ae76a88dd01f7f0ee63b43c4d76bae7dc0cf4952f73538d367ea4a20ce2e10b WatchSource:0}: Error finding container 4ae76a88dd01f7f0ee63b43c4d76bae7dc0cf4952f73538d367ea4a20ce2e10b: Status 404 returned error can't find the container with id 4ae76a88dd01f7f0ee63b43c4d76bae7dc0cf4952f73538d367ea4a20ce2e10b
Aug 04 00:11:17.788169 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:17.788128    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6ff97d667-2wb7c" event={"ID":"70939b25-9187-42fd-aed4-c9bafadd4e62","Type":"ContainerStarted","Data":"5716ce1c164604817e84a70dfade4ebccbd67893f6fdb20b7a9bf6782026f160"}
Aug 04 00:11:17.788169 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:17.788163    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-cbpr4"
Aug 04 00:11:17.788415 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:17.788180    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6ff97d667-2wb7c" event={"ID":"70939b25-9187-42fd-aed4-c9bafadd4e62","Type":"ContainerStarted","Data":"4ae76a88dd01f7f0ee63b43c4d76bae7dc0cf4952f73538d367ea4a20ce2e10b"}
Aug 04 00:11:17.788415 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:17.788186    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-zkrdv"
Aug 04 00:11:17.853810 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:17.853671    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6ff97d667-2wb7c" podStartSLOduration=1.374370406 podStartE2EDuration="1.853647684s" totalImagesPullingTime="479.277278ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:11:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:11:17.826983468 +0000 UTC m=+531.995620895" watchObservedRunningTime="2026-08-04 00:11:17.853647684 +0000 UTC m=+532.022285057"
Aug 04 00:11:17.868391 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:17.868361    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-zkrdv"]
Aug 04 00:11:17.875305 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:17.875279    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687bd45585-zkrdv"]
Aug 04 00:11:17.899094 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:17.899064    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-cbpr4"]
Aug 04 00:11:17.902789 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:17.902760    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-cbpr4"]
Aug 04 00:11:18.307457 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:18.307418    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d1578c8-8610-4a23-bdc4-8b8f383471b3" path="/var/lib/kubelet/pods/0d1578c8-8610-4a23-bdc4-8b8f383471b3/volumes"
Aug 04 00:11:18.307745 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:11:18.307709    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55" path="/var/lib/kubelet/pods/d0d66ea7-4a6e-4a6f-b499-f86df5ee4a55/volumes"
Aug 04 00:12:26.217914 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:26.217881    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:12:26.220968 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:26.220929    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:12:49.973855 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:49.973775    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"]
Aug 04 00:12:49.977085 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:49.977066    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"
Aug 04 00:12:49.979951 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:49.979933    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 04 00:12:49.980877 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:49.980861    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 04 00:12:49.980953 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:49.980887    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Aug 04 00:12:49.980997 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:49.980967    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nc2tq\""
Aug 04 00:12:49.995746 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:49.995702    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"]
Aug 04 00:12:50.012696 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:50.012663    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66ebea31-67e0-46a3-a829-0aefdd1834be-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb\" (UID: \"66ebea31-67e0-46a3-a829-0aefdd1834be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"
Aug 04 00:12:50.012828 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:50.012702    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cnhj\" (UniqueName: \"kubernetes.io/projected/66ebea31-67e0-46a3-a829-0aefdd1834be-kube-api-access-4cnhj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb\" (UID: \"66ebea31-67e0-46a3-a829-0aefdd1834be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"
Aug 04 00:12:50.012828 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:50.012781    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66ebea31-67e0-46a3-a829-0aefdd1834be-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb\" (UID: \"66ebea31-67e0-46a3-a829-0aefdd1834be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"
Aug 04 00:12:50.012828 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:50.012809    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66ebea31-67e0-46a3-a829-0aefdd1834be-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb\" (UID: \"66ebea31-67e0-46a3-a829-0aefdd1834be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"
Aug 04 00:12:50.012941 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:50.012866    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66ebea31-67e0-46a3-a829-0aefdd1834be-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb\" (UID: \"66ebea31-67e0-46a3-a829-0aefdd1834be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"
Aug 04 00:12:50.012941 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:50.012903    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66ebea31-67e0-46a3-a829-0aefdd1834be-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb\" (UID: \"66ebea31-67e0-46a3-a829-0aefdd1834be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"
Aug 04 00:12:50.114105 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:50.114072    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66ebea31-67e0-46a3-a829-0aefdd1834be-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb\" (UID: \"66ebea31-67e0-46a3-a829-0aefdd1834be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"
Aug 04 00:12:50.114246 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:50.114113    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66ebea31-67e0-46a3-a829-0aefdd1834be-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb\" (UID: \"66ebea31-67e0-46a3-a829-0aefdd1834be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"
Aug 04 00:12:50.114290 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:50.114243    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66ebea31-67e0-46a3-a829-0aefdd1834be-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb\" (UID: \"66ebea31-67e0-46a3-a829-0aefdd1834be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"
Aug 04 00:12:50.114337 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:50.114284    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cnhj\" (UniqueName: \"kubernetes.io/projected/66ebea31-67e0-46a3-a829-0aefdd1834be-kube-api-access-4cnhj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb\" (UID: \"66ebea31-67e0-46a3-a829-0aefdd1834be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"
Aug 04 00:12:50.114383 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:50.114352    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66ebea31-67e0-46a3-a829-0aefdd1834be-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb\" (UID: \"66ebea31-67e0-46a3-a829-0aefdd1834be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"
Aug 04 00:12:50.114437 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:50.114411    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66ebea31-67e0-46a3-a829-0aefdd1834be-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb\" (UID: \"66ebea31-67e0-46a3-a829-0aefdd1834be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"
Aug 04 00:12:50.114488 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:50.114442    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66ebea31-67e0-46a3-a829-0aefdd1834be-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb\" (UID: \"66ebea31-67e0-46a3-a829-0aefdd1834be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"
Aug 04 00:12:50.114679 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:50.114659    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66ebea31-67e0-46a3-a829-0aefdd1834be-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb\" (UID: \"66ebea31-67e0-46a3-a829-0aefdd1834be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"
Aug 04 00:12:50.114842 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:50.114821    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66ebea31-67e0-46a3-a829-0aefdd1834be-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb\" (UID: \"66ebea31-67e0-46a3-a829-0aefdd1834be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"
Aug 04 00:12:50.116329 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:50.116307    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66ebea31-67e0-46a3-a829-0aefdd1834be-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb\" (UID: \"66ebea31-67e0-46a3-a829-0aefdd1834be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"
Aug 04 00:12:50.116575 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:50.116557    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66ebea31-67e0-46a3-a829-0aefdd1834be-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb\" (UID: \"66ebea31-67e0-46a3-a829-0aefdd1834be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"
Aug 04 00:12:50.122811 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:50.122791    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cnhj\" (UniqueName: \"kubernetes.io/projected/66ebea31-67e0-46a3-a829-0aefdd1834be-kube-api-access-4cnhj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb\" (UID: \"66ebea31-67e0-46a3-a829-0aefdd1834be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"
Aug 04 00:12:50.287611 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:50.287580    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"
Aug 04 00:12:50.419648 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:50.419620    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"]
Aug 04 00:12:50.423765 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:12:50.423733    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66ebea31_67e0_46a3_a829_0aefdd1834be.slice/crio-f32cfd5eea0ce66ef0ed869fd1aa0bf8bc753e8af3e287d872be5fa7504ede5e WatchSource:0}: Error finding container f32cfd5eea0ce66ef0ed869fd1aa0bf8bc753e8af3e287d872be5fa7504ede5e: Status 404 returned error can't find the container with id f32cfd5eea0ce66ef0ed869fd1aa0bf8bc753e8af3e287d872be5fa7504ede5e
Aug 04 00:12:50.425553 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:50.425537    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 00:12:51.229788 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:51.229736    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb" event={"ID":"66ebea31-67e0-46a3-a829-0aefdd1834be","Type":"ContainerStarted","Data":"f32cfd5eea0ce66ef0ed869fd1aa0bf8bc753e8af3e287d872be5fa7504ede5e"}
Aug 04 00:12:52.236342 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:52.236303    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb" event={"ID":"66ebea31-67e0-46a3-a829-0aefdd1834be","Type":"ContainerStarted","Data":"d1482d2df241464f4a44c0401aaa2d47ec4ac56a4b99e1507dfa546f14dd95d4"}
Aug 04 00:12:52.254444 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:12:52.254382    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb" podStartSLOduration=2.21284853 podStartE2EDuration="3.254361646s" totalImagesPullingTime="1.041513116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:12:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:12:52.254290848 +0000 UTC m=+626.422928246" watchObservedRunningTime="2026-08-04 00:12:52.254361646 +0000 UTC m=+626.422999016"
Aug 04 00:13:00.288368 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:13:00.288337    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"
Aug 04 00:13:00.288801 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:13:00.288399    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"
Aug 04 00:13:00.300377 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:13:00.300351    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"
Aug 04 00:13:01.292541 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:13:01.292506    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb"
Aug 04 00:14:04.538123 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:04.538085    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8454d85f66-mhktw"]
Aug 04 00:14:04.541554 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:04.541536    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8454d85f66-mhktw"
Aug 04 00:14:04.548785 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:04.548573    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8454d85f66-mhktw"]
Aug 04 00:14:04.686675 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:04.686643    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkcz7\" (UniqueName: \"kubernetes.io/projected/7ef51f93-dbe2-443b-bc49-9d49d6b2f41e-kube-api-access-mkcz7\") pod \"authorino-8454d85f66-mhktw\" (UID: \"7ef51f93-dbe2-443b-bc49-9d49d6b2f41e\") " pod="kuadrant-system/authorino-8454d85f66-mhktw"
Aug 04 00:14:04.686675 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:04.686679    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7ef51f93-dbe2-443b-bc49-9d49d6b2f41e-tls-cert\") pod \"authorino-8454d85f66-mhktw\" (UID: \"7ef51f93-dbe2-443b-bc49-9d49d6b2f41e\") " pod="kuadrant-system/authorino-8454d85f66-mhktw"
Aug 04 00:14:04.788037 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:04.788004    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkcz7\" (UniqueName: \"kubernetes.io/projected/7ef51f93-dbe2-443b-bc49-9d49d6b2f41e-kube-api-access-mkcz7\") pod \"authorino-8454d85f66-mhktw\" (UID: \"7ef51f93-dbe2-443b-bc49-9d49d6b2f41e\") " pod="kuadrant-system/authorino-8454d85f66-mhktw"
Aug 04 00:14:04.788037 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:04.788037    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7ef51f93-dbe2-443b-bc49-9d49d6b2f41e-tls-cert\") pod \"authorino-8454d85f66-mhktw\" (UID: \"7ef51f93-dbe2-443b-bc49-9d49d6b2f41e\") " pod="kuadrant-system/authorino-8454d85f66-mhktw"
Aug 04 00:14:04.790520 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:04.790467    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7ef51f93-dbe2-443b-bc49-9d49d6b2f41e-tls-cert\") pod \"authorino-8454d85f66-mhktw\" (UID: \"7ef51f93-dbe2-443b-bc49-9d49d6b2f41e\") " pod="kuadrant-system/authorino-8454d85f66-mhktw"
Aug 04 00:14:04.796030 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:04.796002    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkcz7\" (UniqueName: \"kubernetes.io/projected/7ef51f93-dbe2-443b-bc49-9d49d6b2f41e-kube-api-access-mkcz7\") pod \"authorino-8454d85f66-mhktw\" (UID: \"7ef51f93-dbe2-443b-bc49-9d49d6b2f41e\") " pod="kuadrant-system/authorino-8454d85f66-mhktw"
Aug 04 00:14:04.851891 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:04.851867    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8454d85f66-mhktw"
Aug 04 00:14:04.978354 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:04.978331    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8454d85f66-mhktw"]
Aug 04 00:14:04.981301 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:14:04.981277    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ef51f93_dbe2_443b_bc49_9d49d6b2f41e.slice/crio-3d60cb5939916aeaca57ecd635b2f24699fb186c60cce955307d9493dd4fcf72 WatchSource:0}: Error finding container 3d60cb5939916aeaca57ecd635b2f24699fb186c60cce955307d9493dd4fcf72: Status 404 returned error can't find the container with id 3d60cb5939916aeaca57ecd635b2f24699fb186c60cce955307d9493dd4fcf72
Aug 04 00:14:05.590766 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:05.590730    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8454d85f66-mhktw" event={"ID":"7ef51f93-dbe2-443b-bc49-9d49d6b2f41e","Type":"ContainerStarted","Data":"3d60cb5939916aeaca57ecd635b2f24699fb186c60cce955307d9493dd4fcf72"}
Aug 04 00:14:06.599730 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:06.599667    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8454d85f66-mhktw" event={"ID":"7ef51f93-dbe2-443b-bc49-9d49d6b2f41e","Type":"ContainerStarted","Data":"4982da2bb562a4acf0fedad2f5120633b78b569ccd5cc77cbbf0868ee3b606a8"}
Aug 04 00:14:06.619333 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:06.619265    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8454d85f66-mhktw" podStartSLOduration=1.887672542 podStartE2EDuration="2.619244013s" totalImagesPullingTime="731.571471ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:14:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:14:06.618944578 +0000 UTC m=+700.787581948" watchObservedRunningTime="2026-08-04 00:14:06.619244013 +0000 UTC m=+700.787881384"
Aug 04 00:14:06.647282 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:06.647007    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6ff97d667-2wb7c"]
Aug 04 00:14:06.648002 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:06.647507    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6ff97d667-2wb7c" podUID="70939b25-9187-42fd-aed4-c9bafadd4e62" containerName="authorino" containerID="cri-o://5716ce1c164604817e84a70dfade4ebccbd67893f6fdb20b7a9bf6782026f160" gracePeriod=30
Aug 04 00:14:06.907393 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:06.907368    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6ff97d667-2wb7c"
Aug 04 00:14:07.011122 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:07.011087    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/70939b25-9187-42fd-aed4-c9bafadd4e62-tls-cert\") pod \"70939b25-9187-42fd-aed4-c9bafadd4e62\" (UID: \"70939b25-9187-42fd-aed4-c9bafadd4e62\") "
Aug 04 00:14:07.011313 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:07.011139    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6h7ls\" (UniqueName: \"kubernetes.io/projected/70939b25-9187-42fd-aed4-c9bafadd4e62-kube-api-access-6h7ls\") pod \"70939b25-9187-42fd-aed4-c9bafadd4e62\" (UID: \"70939b25-9187-42fd-aed4-c9bafadd4e62\") "
Aug 04 00:14:07.013150 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:07.013119    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70939b25-9187-42fd-aed4-c9bafadd4e62-kube-api-access-6h7ls" (OuterVolumeSpecName: "kube-api-access-6h7ls") pod "70939b25-9187-42fd-aed4-c9bafadd4e62" (UID: "70939b25-9187-42fd-aed4-c9bafadd4e62"). InnerVolumeSpecName "kube-api-access-6h7ls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:14:07.020869 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:07.020837    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70939b25-9187-42fd-aed4-c9bafadd4e62-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "70939b25-9187-42fd-aed4-c9bafadd4e62" (UID: "70939b25-9187-42fd-aed4-c9bafadd4e62"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:14:07.112998 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:07.112960    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6h7ls\" (UniqueName: \"kubernetes.io/projected/70939b25-9187-42fd-aed4-c9bafadd4e62-kube-api-access-6h7ls\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:14:07.112998 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:07.112997    2556 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/70939b25-9187-42fd-aed4-c9bafadd4e62-tls-cert\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:14:07.605583 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:07.605544    2556 generic.go:356] "Generic (PLEG): container finished" podID="70939b25-9187-42fd-aed4-c9bafadd4e62" containerID="5716ce1c164604817e84a70dfade4ebccbd67893f6fdb20b7a9bf6782026f160" exitCode=0
Aug 04 00:14:07.605583 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:07.605586    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6ff97d667-2wb7c"
Aug 04 00:14:07.606132 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:07.605626    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6ff97d667-2wb7c" event={"ID":"70939b25-9187-42fd-aed4-c9bafadd4e62","Type":"ContainerDied","Data":"5716ce1c164604817e84a70dfade4ebccbd67893f6fdb20b7a9bf6782026f160"}
Aug 04 00:14:07.606132 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:07.605679    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6ff97d667-2wb7c" event={"ID":"70939b25-9187-42fd-aed4-c9bafadd4e62","Type":"ContainerDied","Data":"4ae76a88dd01f7f0ee63b43c4d76bae7dc0cf4952f73538d367ea4a20ce2e10b"}
Aug 04 00:14:07.606132 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:07.605709    2556 scope.go:117] "RemoveContainer" containerID="5716ce1c164604817e84a70dfade4ebccbd67893f6fdb20b7a9bf6782026f160"
Aug 04 00:14:07.616304 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:07.616278    2556 scope.go:117] "RemoveContainer" containerID="5716ce1c164604817e84a70dfade4ebccbd67893f6fdb20b7a9bf6782026f160"
Aug 04 00:14:07.616581 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:14:07.616561    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5716ce1c164604817e84a70dfade4ebccbd67893f6fdb20b7a9bf6782026f160\": container with ID starting with 5716ce1c164604817e84a70dfade4ebccbd67893f6fdb20b7a9bf6782026f160 not found: ID does not exist" containerID="5716ce1c164604817e84a70dfade4ebccbd67893f6fdb20b7a9bf6782026f160"
Aug 04 00:14:07.616631 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:07.616590    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5716ce1c164604817e84a70dfade4ebccbd67893f6fdb20b7a9bf6782026f160"} err="failed to get container status \"5716ce1c164604817e84a70dfade4ebccbd67893f6fdb20b7a9bf6782026f160\": rpc error: code = NotFound desc = could not find container \"5716ce1c164604817e84a70dfade4ebccbd67893f6fdb20b7a9bf6782026f160\": container with ID starting with 5716ce1c164604817e84a70dfade4ebccbd67893f6fdb20b7a9bf6782026f160 not found: ID does not exist"
Aug 04 00:14:07.632274 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:07.632244    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6ff97d667-2wb7c"]
Aug 04 00:14:07.636609 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:07.636586    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6ff97d667-2wb7c"]
Aug 04 00:14:08.309046 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:14:08.309013    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70939b25-9187-42fd-aed4-c9bafadd4e62" path="/var/lib/kubelet/pods/70939b25-9187-42fd-aed4-c9bafadd4e62/volumes"
Aug 04 00:15:00.137412 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:15:00.137371    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763375-4rf8s"]
Aug 04 00:15:00.138066 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:15:00.137987    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70939b25-9187-42fd-aed4-c9bafadd4e62" containerName="authorino"
Aug 04 00:15:00.138066 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:15:00.138006    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="70939b25-9187-42fd-aed4-c9bafadd4e62" containerName="authorino"
Aug 04 00:15:00.138209 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:15:00.138103    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="70939b25-9187-42fd-aed4-c9bafadd4e62" containerName="authorino"
Aug 04 00:15:00.140952 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:15:00.140934    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763375-4rf8s"
Aug 04 00:15:00.143319 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:15:00.143294    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8db7m\""
Aug 04 00:15:00.147867 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:15:00.147842    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763375-4rf8s"]
Aug 04 00:15:00.152095 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:15:00.152075    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763375-4rf8s"
Aug 04 00:15:00.283341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:15:00.283315    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763375-4rf8s"]
Aug 04 00:15:00.285817 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:15:00.285786    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38434e90_302a_4f81_9759_60428302cae6.slice/crio-de0e0c0341a56bf939ddb3e199429abd2f38fb772f2e6da9fa9327179e5a6dd9 WatchSource:0}: Error finding container de0e0c0341a56bf939ddb3e199429abd2f38fb772f2e6da9fa9327179e5a6dd9: Status 404 returned error can't find the container with id de0e0c0341a56bf939ddb3e199429abd2f38fb772f2e6da9fa9327179e5a6dd9
Aug 04 00:15:00.862534 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:15:00.862470    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763375-4rf8s" event={"ID":"38434e90-302a-4f81-9759-60428302cae6","Type":"ContainerStarted","Data":"de0e0c0341a56bf939ddb3e199429abd2f38fb772f2e6da9fa9327179e5a6dd9"}
Aug 04 00:15:04.883634 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:15:04.883594    2556 generic.go:356] "Generic (PLEG): container finished" podID="38434e90-302a-4f81-9759-60428302cae6" containerID="781595e6762509a74aa2de0ccd6d3ee64fb783441f20bc9d687b71b8e23f1490" exitCode=0
Aug 04 00:15:04.884027 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:15:04.883687    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763375-4rf8s" event={"ID":"38434e90-302a-4f81-9759-60428302cae6","Type":"ContainerDied","Data":"781595e6762509a74aa2de0ccd6d3ee64fb783441f20bc9d687b71b8e23f1490"}
Aug 04 00:15:06.027893 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:15:06.027869    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763375-4rf8s"
Aug 04 00:15:06.895001 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:15:06.894972    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763375-4rf8s"
Aug 04 00:15:06.895170 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:15:06.894967    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763375-4rf8s" event={"ID":"38434e90-302a-4f81-9759-60428302cae6","Type":"ContainerDied","Data":"de0e0c0341a56bf939ddb3e199429abd2f38fb772f2e6da9fa9327179e5a6dd9"}
Aug 04 00:15:06.895170 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:15:06.895092    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de0e0c0341a56bf939ddb3e199429abd2f38fb772f2e6da9fa9327179e5a6dd9"
Aug 04 00:17:26.249748 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:17:26.249658    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:17:26.250752 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:17:26.250708    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:22:26.281614 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:22:26.281520    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:22:26.282166 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:22:26.281627    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:26:47.909519 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:47.909480    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"]
Aug 04 00:26:47.911825 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:47.909891    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38434e90-302a-4f81-9759-60428302cae6" containerName="cleanup"
Aug 04 00:26:47.911825 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:47.909903    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="38434e90-302a-4f81-9759-60428302cae6" containerName="cleanup"
Aug 04 00:26:47.911825 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:47.909966    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="38434e90-302a-4f81-9759-60428302cae6" containerName="cleanup"
Aug 04 00:26:47.912570 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:47.912553    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:26:47.915586 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:47.915565    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-32d0dd13-kserve-self-signed-certs\""
Aug 04 00:26:47.928235 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:47.928212    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"]
Aug 04 00:26:48.001674 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:48.001643    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da176d20-7e53-424c-ac45-402bed264e49-home\") pod \"e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7\" (UID: \"da176d20-7e53-424c-ac45-402bed264e49\") " pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:26:48.001866 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:48.001693    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da176d20-7e53-424c-ac45-402bed264e49-model-cache\") pod \"e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7\" (UID: \"da176d20-7e53-424c-ac45-402bed264e49\") " pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:26:48.001866 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:48.001803    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da176d20-7e53-424c-ac45-402bed264e49-tmp-dir\") pod \"e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7\" (UID: \"da176d20-7e53-424c-ac45-402bed264e49\") " pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:26:48.001866 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:48.001833    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da176d20-7e53-424c-ac45-402bed264e49-tls-certs\") pod \"e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7\" (UID: \"da176d20-7e53-424c-ac45-402bed264e49\") " pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:26:48.001866 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:48.001854    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzc6x\" (UniqueName: \"kubernetes.io/projected/da176d20-7e53-424c-ac45-402bed264e49-kube-api-access-zzc6x\") pod \"e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7\" (UID: \"da176d20-7e53-424c-ac45-402bed264e49\") " pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:26:48.002010 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:48.001936    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da176d20-7e53-424c-ac45-402bed264e49-dshm\") pod \"e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7\" (UID: \"da176d20-7e53-424c-ac45-402bed264e49\") " pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:26:48.102870 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:48.102837    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da176d20-7e53-424c-ac45-402bed264e49-tmp-dir\") pod \"e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7\" (UID: \"da176d20-7e53-424c-ac45-402bed264e49\") " pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:26:48.102870 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:48.102870    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da176d20-7e53-424c-ac45-402bed264e49-tls-certs\") pod \"e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7\" (UID: \"da176d20-7e53-424c-ac45-402bed264e49\") " pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:26:48.103094 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:48.102893    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzc6x\" (UniqueName: \"kubernetes.io/projected/da176d20-7e53-424c-ac45-402bed264e49-kube-api-access-zzc6x\") pod \"e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7\" (UID: \"da176d20-7e53-424c-ac45-402bed264e49\") " pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:26:48.103094 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:48.102924    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da176d20-7e53-424c-ac45-402bed264e49-dshm\") pod \"e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7\" (UID: \"da176d20-7e53-424c-ac45-402bed264e49\") " pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:26:48.103094 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:48.102946    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da176d20-7e53-424c-ac45-402bed264e49-home\") pod \"e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7\" (UID: \"da176d20-7e53-424c-ac45-402bed264e49\") " pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:26:48.103094 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:48.102986    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da176d20-7e53-424c-ac45-402bed264e49-model-cache\") pod \"e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7\" (UID: \"da176d20-7e53-424c-ac45-402bed264e49\") " pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:26:48.103330 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:48.103298    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da176d20-7e53-424c-ac45-402bed264e49-tmp-dir\") pod \"e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7\" (UID: \"da176d20-7e53-424c-ac45-402bed264e49\") " pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:26:48.103445 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:48.103353    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da176d20-7e53-424c-ac45-402bed264e49-model-cache\") pod \"e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7\" (UID: \"da176d20-7e53-424c-ac45-402bed264e49\") " pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:26:48.103445 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:48.103394    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da176d20-7e53-424c-ac45-402bed264e49-home\") pod \"e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7\" (UID: \"da176d20-7e53-424c-ac45-402bed264e49\") " pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:26:48.105329 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:48.105300    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da176d20-7e53-424c-ac45-402bed264e49-dshm\") pod \"e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7\" (UID: \"da176d20-7e53-424c-ac45-402bed264e49\") " pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:26:48.105561 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:48.105541    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da176d20-7e53-424c-ac45-402bed264e49-tls-certs\") pod \"e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7\" (UID: \"da176d20-7e53-424c-ac45-402bed264e49\") " pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:26:48.110688 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:48.110669    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzc6x\" (UniqueName: \"kubernetes.io/projected/da176d20-7e53-424c-ac45-402bed264e49-kube-api-access-zzc6x\") pod \"e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7\" (UID: \"da176d20-7e53-424c-ac45-402bed264e49\") " pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:26:48.222345 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:48.222246    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:26:48.360475 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:48.360366    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"]
Aug 04 00:26:48.363502 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:26:48.363474    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda176d20_7e53_424c_ac45_402bed264e49.slice/crio-415b74d79c9deb27657ac059b356038b96eb75146c9b0521e332e5f6b17181f5 WatchSource:0}: Error finding container 415b74d79c9deb27657ac059b356038b96eb75146c9b0521e332e5f6b17181f5: Status 404 returned error can't find the container with id 415b74d79c9deb27657ac059b356038b96eb75146c9b0521e332e5f6b17181f5
Aug 04 00:26:49.298220 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:49.298180    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7" event={"ID":"da176d20-7e53-424c-ac45-402bed264e49","Type":"ContainerStarted","Data":"4e5232877feb3f58311b24195aa99531bc4f5b5a04ae626d15d11b8d69ee1cee"}
Aug 04 00:26:49.298605 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:49.298234    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7" event={"ID":"da176d20-7e53-424c-ac45-402bed264e49","Type":"ContainerStarted","Data":"415b74d79c9deb27657ac059b356038b96eb75146c9b0521e332e5f6b17181f5"}
Aug 04 00:26:49.316872 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:49.316815    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7" podStartSLOduration=2.316792054 podStartE2EDuration="2.316792054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:26:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:26:49.315248644 +0000 UTC m=+1463.483886015" watchObservedRunningTime="2026-08-04 00:26:49.316792054 +0000 UTC m=+1463.485429424"
Aug 04 00:26:58.222988 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:58.222888    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:26:58.222988 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:58.222947    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:26:58.235919 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:58.235891    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:26:58.357363 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:26:58.357335    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:27:03.992454 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:03.992318    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"]
Aug 04 00:27:03.996374 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:03.996348    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:03.999007 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:03.998981    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-32d0dd13-kserve-self-signed-certs\""
Aug 04 00:27:04.005750 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:04.005704    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"]
Aug 04 00:27:04.155153 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:04.155113    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c1e3717-b172-4b59-b2f6-d05aae8dab68-model-cache\") pod \"e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz\" (UID: \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\") " pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:04.155338 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:04.155182    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c1e3717-b172-4b59-b2f6-d05aae8dab68-home\") pod \"e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz\" (UID: \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\") " pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:04.155338 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:04.155235    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c1e3717-b172-4b59-b2f6-d05aae8dab68-dshm\") pod \"e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz\" (UID: \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\") " pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:04.155338 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:04.155263    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjb9d\" (UniqueName: \"kubernetes.io/projected/7c1e3717-b172-4b59-b2f6-d05aae8dab68-kube-api-access-zjb9d\") pod \"e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz\" (UID: \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\") " pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:04.155450 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:04.155348    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c1e3717-b172-4b59-b2f6-d05aae8dab68-tls-certs\") pod \"e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz\" (UID: \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\") " pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:04.155450 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:04.155380    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c1e3717-b172-4b59-b2f6-d05aae8dab68-tmp-dir\") pod \"e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz\" (UID: \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\") " pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:04.256165 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:04.256118    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c1e3717-b172-4b59-b2f6-d05aae8dab68-home\") pod \"e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz\" (UID: \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\") " pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:04.256353 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:04.256197    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c1e3717-b172-4b59-b2f6-d05aae8dab68-dshm\") pod \"e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz\" (UID: \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\") " pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:04.256353 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:04.256221    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjb9d\" (UniqueName: \"kubernetes.io/projected/7c1e3717-b172-4b59-b2f6-d05aae8dab68-kube-api-access-zjb9d\") pod \"e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz\" (UID: \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\") " pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:04.256353 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:04.256248    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c1e3717-b172-4b59-b2f6-d05aae8dab68-tls-certs\") pod \"e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz\" (UID: \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\") " pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:04.256353 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:04.256264    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c1e3717-b172-4b59-b2f6-d05aae8dab68-tmp-dir\") pod \"e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz\" (UID: \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\") " pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:04.256353 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:04.256302    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c1e3717-b172-4b59-b2f6-d05aae8dab68-model-cache\") pod \"e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz\" (UID: \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\") " pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:04.256617 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:04.256568    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c1e3717-b172-4b59-b2f6-d05aae8dab68-home\") pod \"e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz\" (UID: \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\") " pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:04.256664 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:04.256638    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c1e3717-b172-4b59-b2f6-d05aae8dab68-tmp-dir\") pod \"e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz\" (UID: \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\") " pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:04.256745 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:04.256698    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c1e3717-b172-4b59-b2f6-d05aae8dab68-model-cache\") pod \"e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz\" (UID: \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\") " pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:04.258531 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:04.258502    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c1e3717-b172-4b59-b2f6-d05aae8dab68-dshm\") pod \"e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz\" (UID: \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\") " pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:04.258708 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:04.258691    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c1e3717-b172-4b59-b2f6-d05aae8dab68-tls-certs\") pod \"e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz\" (UID: \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\") " pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:04.265517 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:04.265489    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjb9d\" (UniqueName: \"kubernetes.io/projected/7c1e3717-b172-4b59-b2f6-d05aae8dab68-kube-api-access-zjb9d\") pod \"e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz\" (UID: \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\") " pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:04.308581 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:04.308551    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:04.448749 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:04.448699    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"]
Aug 04 00:27:04.450771 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:27:04.450746    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c1e3717_b172_4b59_b2f6_d05aae8dab68.slice/crio-0ea804fc63f96c73e3f67650629a668f1f29e7508c56c55f100944480d92648b WatchSource:0}: Error finding container 0ea804fc63f96c73e3f67650629a668f1f29e7508c56c55f100944480d92648b: Status 404 returned error can't find the container with id 0ea804fc63f96c73e3f67650629a668f1f29e7508c56c55f100944480d92648b
Aug 04 00:27:05.382844 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:05.382806    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz" event={"ID":"7c1e3717-b172-4b59-b2f6-d05aae8dab68","Type":"ContainerStarted","Data":"0da4db544fbf402c20f9724893d4a2abd53ba4af9edcd4adc0bcad02761f429f"}
Aug 04 00:27:05.383241 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:05.382856    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz" event={"ID":"7c1e3717-b172-4b59-b2f6-d05aae8dab68","Type":"ContainerStarted","Data":"0ea804fc63f96c73e3f67650629a668f1f29e7508c56c55f100944480d92648b"}
Aug 04 00:27:05.398969 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:05.398906    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz" podStartSLOduration=2.398883575 podStartE2EDuration="2.398883575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:27:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:27:05.39861478 +0000 UTC m=+1479.567252151" watchObservedRunningTime="2026-08-04 00:27:05.398883575 +0000 UTC m=+1479.567520925"
Aug 04 00:27:14.309683 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:14.309646    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:14.310093 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:14.309695    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:14.322154 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:14.322122    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:14.436601 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:14.436568    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:26.322303 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:26.322272    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:27:26.324645 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:26.324623    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:27:29.569426 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:29.569390    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"]
Aug 04 00:27:30.308645 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:30.308612    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"]
Aug 04 00:27:44.588483 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:44.588413    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7" podUID="da176d20-7e53-424c-ac45-402bed264e49" containerName="main" containerID="cri-o://4e5232877feb3f58311b24195aa99531bc4f5b5a04ae626d15d11b8d69ee1cee" gracePeriod=45
Aug 04 00:27:44.839139 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:44.839063    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:27:44.929422 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:44.929386    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da176d20-7e53-424c-ac45-402bed264e49-tls-certs\") pod \"da176d20-7e53-424c-ac45-402bed264e49\" (UID: \"da176d20-7e53-424c-ac45-402bed264e49\") "
Aug 04 00:27:44.929595 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:44.929435    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzc6x\" (UniqueName: \"kubernetes.io/projected/da176d20-7e53-424c-ac45-402bed264e49-kube-api-access-zzc6x\") pod \"da176d20-7e53-424c-ac45-402bed264e49\" (UID: \"da176d20-7e53-424c-ac45-402bed264e49\") "
Aug 04 00:27:44.929595 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:44.929468    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da176d20-7e53-424c-ac45-402bed264e49-tmp-dir\") pod \"da176d20-7e53-424c-ac45-402bed264e49\" (UID: \"da176d20-7e53-424c-ac45-402bed264e49\") "
Aug 04 00:27:44.929731 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:44.929687    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da176d20-7e53-424c-ac45-402bed264e49-model-cache\") pod \"da176d20-7e53-424c-ac45-402bed264e49\" (UID: \"da176d20-7e53-424c-ac45-402bed264e49\") "
Aug 04 00:27:44.929832 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:44.929692    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da176d20-7e53-424c-ac45-402bed264e49-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "da176d20-7e53-424c-ac45-402bed264e49" (UID: "da176d20-7e53-424c-ac45-402bed264e49"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:27:44.929979 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:44.929855    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da176d20-7e53-424c-ac45-402bed264e49-model-cache" (OuterVolumeSpecName: "model-cache") pod "da176d20-7e53-424c-ac45-402bed264e49" (UID: "da176d20-7e53-424c-ac45-402bed264e49"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:27:44.929979 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:44.929858    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da176d20-7e53-424c-ac45-402bed264e49-home\") pod \"da176d20-7e53-424c-ac45-402bed264e49\" (UID: \"da176d20-7e53-424c-ac45-402bed264e49\") "
Aug 04 00:27:44.929979 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:44.929934    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da176d20-7e53-424c-ac45-402bed264e49-dshm\") pod \"da176d20-7e53-424c-ac45-402bed264e49\" (UID: \"da176d20-7e53-424c-ac45-402bed264e49\") "
Aug 04 00:27:44.930144 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:44.929978    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da176d20-7e53-424c-ac45-402bed264e49-home" (OuterVolumeSpecName: "home") pod "da176d20-7e53-424c-ac45-402bed264e49" (UID: "da176d20-7e53-424c-ac45-402bed264e49"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:27:44.930295 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:44.930278    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da176d20-7e53-424c-ac45-402bed264e49-tmp-dir\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:27:44.930350 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:44.930300    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da176d20-7e53-424c-ac45-402bed264e49-model-cache\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:27:44.930350 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:44.930313    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da176d20-7e53-424c-ac45-402bed264e49-home\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:27:44.931815 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:44.931789    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da176d20-7e53-424c-ac45-402bed264e49-kube-api-access-zzc6x" (OuterVolumeSpecName: "kube-api-access-zzc6x") pod "da176d20-7e53-424c-ac45-402bed264e49" (UID: "da176d20-7e53-424c-ac45-402bed264e49"). InnerVolumeSpecName "kube-api-access-zzc6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:27:44.931913 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:44.931842    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da176d20-7e53-424c-ac45-402bed264e49-dshm" (OuterVolumeSpecName: "dshm") pod "da176d20-7e53-424c-ac45-402bed264e49" (UID: "da176d20-7e53-424c-ac45-402bed264e49"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:27:44.931957 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:44.931905    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da176d20-7e53-424c-ac45-402bed264e49-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "da176d20-7e53-424c-ac45-402bed264e49" (UID: "da176d20-7e53-424c-ac45-402bed264e49"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:27:45.031586 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.031551    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da176d20-7e53-424c-ac45-402bed264e49-tls-certs\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:27:45.031586 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.031579    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzc6x\" (UniqueName: \"kubernetes.io/projected/da176d20-7e53-424c-ac45-402bed264e49-kube-api-access-zzc6x\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:27:45.031586 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.031590    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da176d20-7e53-424c-ac45-402bed264e49-dshm\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:27:45.328001 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.327935    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz" podUID="7c1e3717-b172-4b59-b2f6-d05aae8dab68" containerName="main" containerID="cri-o://0da4db544fbf402c20f9724893d4a2abd53ba4af9edcd4adc0bcad02761f429f" gracePeriod=45
Aug 04 00:27:45.564636 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.564608    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:45.589005 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.588927    2556 generic.go:356] "Generic (PLEG): container finished" podID="7c1e3717-b172-4b59-b2f6-d05aae8dab68" containerID="0da4db544fbf402c20f9724893d4a2abd53ba4af9edcd4adc0bcad02761f429f" exitCode=0
Aug 04 00:27:45.589427 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.589024    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"
Aug 04 00:27:45.589427 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.589070    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz" event={"ID":"7c1e3717-b172-4b59-b2f6-d05aae8dab68","Type":"ContainerDied","Data":"0da4db544fbf402c20f9724893d4a2abd53ba4af9edcd4adc0bcad02761f429f"}
Aug 04 00:27:45.589427 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.589127    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz" event={"ID":"7c1e3717-b172-4b59-b2f6-d05aae8dab68","Type":"ContainerDied","Data":"0ea804fc63f96c73e3f67650629a668f1f29e7508c56c55f100944480d92648b"}
Aug 04 00:27:45.589427 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.589151    2556 scope.go:117] "RemoveContainer" containerID="0da4db544fbf402c20f9724893d4a2abd53ba4af9edcd4adc0bcad02761f429f"
Aug 04 00:27:45.590662 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.590638    2556 generic.go:356] "Generic (PLEG): container finished" podID="da176d20-7e53-424c-ac45-402bed264e49" containerID="4e5232877feb3f58311b24195aa99531bc4f5b5a04ae626d15d11b8d69ee1cee" exitCode=0
Aug 04 00:27:45.590820 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.590683    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"
Aug 04 00:27:45.590820 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.590727    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7" event={"ID":"da176d20-7e53-424c-ac45-402bed264e49","Type":"ContainerDied","Data":"4e5232877feb3f58311b24195aa99531bc4f5b5a04ae626d15d11b8d69ee1cee"}
Aug 04 00:27:45.590820 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.590760    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7" event={"ID":"da176d20-7e53-424c-ac45-402bed264e49","Type":"ContainerDied","Data":"415b74d79c9deb27657ac059b356038b96eb75146c9b0521e332e5f6b17181f5"}
Aug 04 00:27:45.599012 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.598998    2556 scope.go:117] "RemoveContainer" containerID="0da4db544fbf402c20f9724893d4a2abd53ba4af9edcd4adc0bcad02761f429f"
Aug 04 00:27:45.599283 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:27:45.599267    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0da4db544fbf402c20f9724893d4a2abd53ba4af9edcd4adc0bcad02761f429f\": container with ID starting with 0da4db544fbf402c20f9724893d4a2abd53ba4af9edcd4adc0bcad02761f429f not found: ID does not exist" containerID="0da4db544fbf402c20f9724893d4a2abd53ba4af9edcd4adc0bcad02761f429f"
Aug 04 00:27:45.599356 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.599297    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0da4db544fbf402c20f9724893d4a2abd53ba4af9edcd4adc0bcad02761f429f"} err="failed to get container status \"0da4db544fbf402c20f9724893d4a2abd53ba4af9edcd4adc0bcad02761f429f\": rpc error: code = NotFound desc = could not find container \"0da4db544fbf402c20f9724893d4a2abd53ba4af9edcd4adc0bcad02761f429f\": container with ID starting with 0da4db544fbf402c20f9724893d4a2abd53ba4af9edcd4adc0bcad02761f429f not found: ID does not exist"
Aug 04 00:27:45.599356 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.599319    2556 scope.go:117] "RemoveContainer" containerID="4e5232877feb3f58311b24195aa99531bc4f5b5a04ae626d15d11b8d69ee1cee"
Aug 04 00:27:45.613759 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.613740    2556 scope.go:117] "RemoveContainer" containerID="4e5232877feb3f58311b24195aa99531bc4f5b5a04ae626d15d11b8d69ee1cee"
Aug 04 00:27:45.614074 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:27:45.614057    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e5232877feb3f58311b24195aa99531bc4f5b5a04ae626d15d11b8d69ee1cee\": container with ID starting with 4e5232877feb3f58311b24195aa99531bc4f5b5a04ae626d15d11b8d69ee1cee not found: ID does not exist" containerID="4e5232877feb3f58311b24195aa99531bc4f5b5a04ae626d15d11b8d69ee1cee"
Aug 04 00:27:45.614136 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.614089    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e5232877feb3f58311b24195aa99531bc4f5b5a04ae626d15d11b8d69ee1cee"} err="failed to get container status \"4e5232877feb3f58311b24195aa99531bc4f5b5a04ae626d15d11b8d69ee1cee\": rpc error: code = NotFound desc = could not find container \"4e5232877feb3f58311b24195aa99531bc4f5b5a04ae626d15d11b8d69ee1cee\": container with ID starting with 4e5232877feb3f58311b24195aa99531bc4f5b5a04ae626d15d11b8d69ee1cee not found: ID does not exist"
Aug 04 00:27:45.628557 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.628525    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"]
Aug 04 00:27:45.636052 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.636026    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-32d0dd13-kserve-77fbf98879-zjhg7"]
Aug 04 00:27:45.738614 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.738579    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjb9d\" (UniqueName: \"kubernetes.io/projected/7c1e3717-b172-4b59-b2f6-d05aae8dab68-kube-api-access-zjb9d\") pod \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\" (UID: \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\") "
Aug 04 00:27:45.738836 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.738623    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c1e3717-b172-4b59-b2f6-d05aae8dab68-tls-certs\") pod \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\" (UID: \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\") "
Aug 04 00:27:45.738836 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.738677    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c1e3717-b172-4b59-b2f6-d05aae8dab68-dshm\") pod \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\" (UID: \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\") "
Aug 04 00:27:45.738836 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.738702    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c1e3717-b172-4b59-b2f6-d05aae8dab68-model-cache\") pod \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\" (UID: \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\") "
Aug 04 00:27:45.738836 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.738772    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c1e3717-b172-4b59-b2f6-d05aae8dab68-tmp-dir\") pod \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\" (UID: \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\") "
Aug 04 00:27:45.738836 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.738810    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c1e3717-b172-4b59-b2f6-d05aae8dab68-home\") pod \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\" (UID: \"7c1e3717-b172-4b59-b2f6-d05aae8dab68\") "
Aug 04 00:27:45.739123 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.739028    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c1e3717-b172-4b59-b2f6-d05aae8dab68-model-cache" (OuterVolumeSpecName: "model-cache") pod "7c1e3717-b172-4b59-b2f6-d05aae8dab68" (UID: "7c1e3717-b172-4b59-b2f6-d05aae8dab68"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:27:45.739123 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.739043    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c1e3717-b172-4b59-b2f6-d05aae8dab68-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7c1e3717-b172-4b59-b2f6-d05aae8dab68" (UID: "7c1e3717-b172-4b59-b2f6-d05aae8dab68"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:27:45.739224 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.739194    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c1e3717-b172-4b59-b2f6-d05aae8dab68-model-cache\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:27:45.739224 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.739216    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c1e3717-b172-4b59-b2f6-d05aae8dab68-tmp-dir\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:27:45.739325 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.739226    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c1e3717-b172-4b59-b2f6-d05aae8dab68-home" (OuterVolumeSpecName: "home") pod "7c1e3717-b172-4b59-b2f6-d05aae8dab68" (UID: "7c1e3717-b172-4b59-b2f6-d05aae8dab68"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:27:45.740890 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.740864    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c1e3717-b172-4b59-b2f6-d05aae8dab68-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7c1e3717-b172-4b59-b2f6-d05aae8dab68" (UID: "7c1e3717-b172-4b59-b2f6-d05aae8dab68"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:27:45.740989 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.740907    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c1e3717-b172-4b59-b2f6-d05aae8dab68-dshm" (OuterVolumeSpecName: "dshm") pod "7c1e3717-b172-4b59-b2f6-d05aae8dab68" (UID: "7c1e3717-b172-4b59-b2f6-d05aae8dab68"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:27:45.740989 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.740942    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c1e3717-b172-4b59-b2f6-d05aae8dab68-kube-api-access-zjb9d" (OuterVolumeSpecName: "kube-api-access-zjb9d") pod "7c1e3717-b172-4b59-b2f6-d05aae8dab68" (UID: "7c1e3717-b172-4b59-b2f6-d05aae8dab68"). InnerVolumeSpecName "kube-api-access-zjb9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:27:45.840528 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.840441    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c1e3717-b172-4b59-b2f6-d05aae8dab68-tls-certs\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:27:45.840528 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.840471    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c1e3717-b172-4b59-b2f6-d05aae8dab68-dshm\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:27:45.840528 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.840483    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c1e3717-b172-4b59-b2f6-d05aae8dab68-home\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:27:45.840528 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.840496    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjb9d\" (UniqueName: \"kubernetes.io/projected/7c1e3717-b172-4b59-b2f6-d05aae8dab68-kube-api-access-zjb9d\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:27:45.909779 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.909747    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"]
Aug 04 00:27:45.913232 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:45.913207    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-32d0dd13-kserve-558d57698c-mkxfz"]
Aug 04 00:27:46.307928 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:46.307894    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c1e3717-b172-4b59-b2f6-d05aae8dab68" path="/var/lib/kubelet/pods/7c1e3717-b172-4b59-b2f6-d05aae8dab68/volumes"
Aug 04 00:27:46.308309 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:27:46.308296    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da176d20-7e53-424c-ac45-402bed264e49" path="/var/lib/kubelet/pods/da176d20-7e53-424c-ac45-402bed264e49/volumes"
Aug 04 00:30:00.137063 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:30:00.137026    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763390-pxms5"]
Aug 04 00:30:00.137671 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:30:00.137403    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da176d20-7e53-424c-ac45-402bed264e49" containerName="main"
Aug 04 00:30:00.137671 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:30:00.137414    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="da176d20-7e53-424c-ac45-402bed264e49" containerName="main"
Aug 04 00:30:00.137671 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:30:00.137436    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c1e3717-b172-4b59-b2f6-d05aae8dab68" containerName="main"
Aug 04 00:30:00.137671 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:30:00.137441    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c1e3717-b172-4b59-b2f6-d05aae8dab68" containerName="main"
Aug 04 00:30:00.137671 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:30:00.137501    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="da176d20-7e53-424c-ac45-402bed264e49" containerName="main"
Aug 04 00:30:00.137671 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:30:00.137513    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c1e3717-b172-4b59-b2f6-d05aae8dab68" containerName="main"
Aug 04 00:30:00.140490 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:30:00.140467    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763390-pxms5"
Aug 04 00:30:00.142955 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:30:00.142928    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8db7m\""
Aug 04 00:30:00.150860 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:30:00.150843    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763390-pxms5"
Aug 04 00:30:00.158053 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:30:00.158029    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763390-pxms5"]
Aug 04 00:30:00.295135 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:30:00.295087    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763390-pxms5"]
Aug 04 00:30:00.297405 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:30:00.297375    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod698b277b_c990_470d_b397_d3a076292f91.slice/crio-8a2d7c8f2e6d143fee70703362553e0396cbb24bea85ab35dc711c4647f24709 WatchSource:0}: Error finding container 8a2d7c8f2e6d143fee70703362553e0396cbb24bea85ab35dc711c4647f24709: Status 404 returned error can't find the container with id 8a2d7c8f2e6d143fee70703362553e0396cbb24bea85ab35dc711c4647f24709
Aug 04 00:30:01.246178 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:30:01.246146    2556 generic.go:356] "Generic (PLEG): container finished" podID="698b277b-c990-470d-b397-d3a076292f91" containerID="8e171c76e2d5f122c8a94b3aba43cdd15ca7199fd6c340f3e8f104c9eb52d33d" exitCode=0
Aug 04 00:30:01.246575 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:30:01.246236    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763390-pxms5" event={"ID":"698b277b-c990-470d-b397-d3a076292f91","Type":"ContainerDied","Data":"8e171c76e2d5f122c8a94b3aba43cdd15ca7199fd6c340f3e8f104c9eb52d33d"}
Aug 04 00:30:01.246575 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:30:01.246295    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763390-pxms5" event={"ID":"698b277b-c990-470d-b397-d3a076292f91","Type":"ContainerStarted","Data":"8a2d7c8f2e6d143fee70703362553e0396cbb24bea85ab35dc711c4647f24709"}
Aug 04 00:30:02.388816 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:30:02.388791    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763390-pxms5"
Aug 04 00:30:03.257470 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:30:03.257441    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763390-pxms5"
Aug 04 00:30:03.257659 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:30:03.257480    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763390-pxms5" event={"ID":"698b277b-c990-470d-b397-d3a076292f91","Type":"ContainerDied","Data":"8a2d7c8f2e6d143fee70703362553e0396cbb24bea85ab35dc711c4647f24709"}
Aug 04 00:30:03.257659 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:30:03.257559    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a2d7c8f2e6d143fee70703362553e0396cbb24bea85ab35dc711c4647f24709"
Aug 04 00:31:26.266787 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.266676    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"]
Aug 04 00:31:26.267268 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.267133    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="698b277b-c990-470d-b397-d3a076292f91" containerName="cleanup"
Aug 04 00:31:26.267268 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.267146    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="698b277b-c990-470d-b397-d3a076292f91" containerName="cleanup"
Aug 04 00:31:26.267268 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.267207    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="698b277b-c990-470d-b397-d3a076292f91" containerName="cleanup"
Aug 04 00:31:26.270303 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.270288    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.272794 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.272777    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1c5d1257-openshift-default-dockercfg-bszfm\""
Aug 04 00:31:26.282226 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.282197    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"]
Aug 04 00:31:26.434776 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.434739    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm9qf\" (UniqueName: \"kubernetes.io/projected/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-kube-api-access-jm9qf\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.434970 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.434804    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istio-data\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.434970 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.434869    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-workload-certs\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.434970 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.434943    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istio-token\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.435106 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.434979    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istio-envoy\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.435106 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.435014    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-workload-socket\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.435106 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.435046    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istiod-ca-cert\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.435215 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.435111    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istio-podinfo\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.435215 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.435137    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-credential-socket\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.535887 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.535800    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istio-token\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.535887 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.535844    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istio-envoy\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.536130 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.535987    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-workload-socket\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.536130 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.536043    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istiod-ca-cert\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.536130 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.536118    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istio-podinfo\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.536292 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.536155    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-credential-socket\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.536292 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.536200    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm9qf\" (UniqueName: \"kubernetes.io/projected/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-kube-api-access-jm9qf\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.536292 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.536249    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istio-data\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.536456 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.536374    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-workload-socket\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.536456 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.536371    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-workload-certs\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.536555 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.536502    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-credential-socket\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.536641 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.536621    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istio-data\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.536762 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.536736    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-workload-certs\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.537031 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.537014    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istiod-ca-cert\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.538258 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.538230    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istio-envoy\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.538461 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.538442    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istio-podinfo\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.544097 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.544071    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istio-token\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.544368 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.544345    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm9qf\" (UniqueName: \"kubernetes.io/projected/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-kube-api-access-jm9qf\") pod \"e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") " pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.581605 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.581574    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:26.729236 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.729207    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"]
Aug 04 00:31:26.731341 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:31:26.731311    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded601dd9_704a_4149_88c0_d3c7a3c9b5dd.slice/crio-1702fced352023e15f230e307c86f4b65b5bfb68d5c329d281482c2e8603fdf6 WatchSource:0}: Error finding container 1702fced352023e15f230e307c86f4b65b5bfb68d5c329d281482c2e8603fdf6: Status 404 returned error can't find the container with id 1702fced352023e15f230e307c86f4b65b5bfb68d5c329d281482c2e8603fdf6
Aug 04 00:31:26.733517 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.733481    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:31:26.733612 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.733565    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:31:26.733612 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:26.733601    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:31:27.666636 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:27.666599    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw" event={"ID":"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd","Type":"ContainerStarted","Data":"c8ef78bc13c3188d36a0791f14f23044b4fbb4f35666d736a34a1c30818daab8"}
Aug 04 00:31:27.667046 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:27.666652    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw" event={"ID":"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd","Type":"ContainerStarted","Data":"1702fced352023e15f230e307c86f4b65b5bfb68d5c329d281482c2e8603fdf6"}
Aug 04 00:31:27.689102 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:27.689050    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw" podStartSLOduration=1.689031749 podStartE2EDuration="1.689031749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:31:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:31:27.68767871 +0000 UTC m=+1741.856316081" watchObservedRunningTime="2026-08-04 00:31:27.689031749 +0000 UTC m=+1741.857669119"
Aug 04 00:31:28.581935 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:28.581892    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:28.587071 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:28.587039    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:28.671831 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:28.671796    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:28.672894 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:28.672876    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:43.673392 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:43.673357    2556 patch_prober.go:28] interesting pod/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Aug 04 00:31:43.673841 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:43.673427    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw" podUID="ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Aug 04 00:31:43.751072 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:43.751038    2556 generic.go:356] "Generic (PLEG): container finished" podID="ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" containerID="c8ef78bc13c3188d36a0791f14f23044b4fbb4f35666d736a34a1c30818daab8" exitCode=0
Aug 04 00:31:43.751248 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:43.751108    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw" event={"ID":"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd","Type":"ContainerDied","Data":"c8ef78bc13c3188d36a0791f14f23044b4fbb4f35666d736a34a1c30818daab8"}
Aug 04 00:31:43.751515 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:43.751501    2556 scope.go:117] "RemoveContainer" containerID="c8ef78bc13c3188d36a0791f14f23044b4fbb4f35666d736a34a1c30818daab8"
Aug 04 00:31:43.752476 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:43.752452    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:31:43.752547 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:43.752533    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:31:43.752587 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:43.752572    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:31:44.762340 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:44.762293    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw" event={"ID":"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd","Type":"ContainerStarted","Data":"467b97f80c2bbea5a75f89f5b61f5444d34510baf3c94858ae05e0456837f2e0"}
Aug 04 00:31:45.582513 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:45.582484    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:45.582794 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:45.582768    2556 patch_prober.go:28] interesting pod/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Aug 04 00:31:45.582877 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:45.582846    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw" podUID="ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Aug 04 00:31:46.582892 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:46.582853    2556 patch_prober.go:28] interesting pod/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Aug 04 00:31:46.583381 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:46.582921    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw" podUID="ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Aug 04 00:31:47.582047 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:47.582005    2556 patch_prober.go:28] interesting pod/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Aug 04 00:31:47.582233 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:47.582062    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw" podUID="ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Aug 04 00:31:48.582639 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:48.582599    2556 patch_prober.go:28] interesting pod/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Aug 04 00:31:48.583059 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:48.582667    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw" podUID="ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Aug 04 00:31:49.582084 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:49.582051    2556 patch_prober.go:28] interesting pod/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Aug 04 00:31:49.582296 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:49.582125    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw" podUID="ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Aug 04 00:31:50.586006 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:50.585963    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:50.586376 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:50.586278    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:50.587073 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:50.587056    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:31:54.509504 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:54.509466    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1c5d1257-frlq5"]
Aug 04 00:31:54.512291 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:54.512274    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1c5d1257-frlq5"
Aug 04 00:31:54.514492 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:54.514471    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8db7m\""
Aug 04 00:31:54.519490 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:54.519450    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1c5d1257-frlq5"]
Aug 04 00:31:54.615920 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:54.615883    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/446c0b4e-05fd-4dfc-9c6e-410cf9944d2e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1c5d1257-frlq5\" (UID: \"446c0b4e-05fd-4dfc-9c6e-410cf9944d2e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1c5d1257-frlq5"
Aug 04 00:31:54.717231 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:54.717193    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/446c0b4e-05fd-4dfc-9c6e-410cf9944d2e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1c5d1257-frlq5\" (UID: \"446c0b4e-05fd-4dfc-9c6e-410cf9944d2e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1c5d1257-frlq5"
Aug 04 00:31:54.717868 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:54.717848    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/446c0b4e-05fd-4dfc-9c6e-410cf9944d2e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1c5d1257-frlq5\" (UID: \"446c0b4e-05fd-4dfc-9c6e-410cf9944d2e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1c5d1257-frlq5"
Aug 04 00:31:54.825216 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:54.825131    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1c5d1257-frlq5"
Aug 04 00:31:54.956778 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:54.956751    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1c5d1257-frlq5"]
Aug 04 00:31:54.959119 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:31:54.959095    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod446c0b4e_05fd_4dfc_9c6e_410cf9944d2e.slice/crio-80055822976af62ef493f617e31acbe9b4392328becca0c0859acfe246ef5804 WatchSource:0}: Error finding container 80055822976af62ef493f617e31acbe9b4392328becca0c0859acfe246ef5804: Status 404 returned error can't find the container with id 80055822976af62ef493f617e31acbe9b4392328becca0c0859acfe246ef5804
Aug 04 00:31:55.824487 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:55.824446    2556 generic.go:356] "Generic (PLEG): container finished" podID="446c0b4e-05fd-4dfc-9c6e-410cf9944d2e" containerID="61cf95c5672b07410a51b41b027d4ee7c372a500d812a9d4164d97e3f7982a4a" exitCode=0
Aug 04 00:31:55.824882 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:55.824508    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1c5d1257-frlq5" event={"ID":"446c0b4e-05fd-4dfc-9c6e-410cf9944d2e","Type":"ContainerDied","Data":"61cf95c5672b07410a51b41b027d4ee7c372a500d812a9d4164d97e3f7982a4a"}
Aug 04 00:31:55.824882 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:55.824587    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1c5d1257-frlq5" event={"ID":"446c0b4e-05fd-4dfc-9c6e-410cf9944d2e","Type":"ContainerStarted","Data":"80055822976af62ef493f617e31acbe9b4392328becca0c0859acfe246ef5804"}
Aug 04 00:31:56.960764 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:56.960740    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1c5d1257-frlq5"
Aug 04 00:31:57.038483 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:57.038454    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/446c0b4e-05fd-4dfc-9c6e-410cf9944d2e-maas-api-service-ca\") pod \"446c0b4e-05fd-4dfc-9c6e-410cf9944d2e\" (UID: \"446c0b4e-05fd-4dfc-9c6e-410cf9944d2e\") "
Aug 04 00:31:57.038833 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:57.038810    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/446c0b4e-05fd-4dfc-9c6e-410cf9944d2e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "446c0b4e-05fd-4dfc-9c6e-410cf9944d2e" (UID: "446c0b4e-05fd-4dfc-9c6e-410cf9944d2e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:31:57.139669 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:57.139590    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/446c0b4e-05fd-4dfc-9c6e-410cf9944d2e-maas-api-service-ca\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:31:57.836778 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:57.836744    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1c5d1257-frlq5"
Aug 04 00:31:57.836778 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:57.836763    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1c5d1257-frlq5" event={"ID":"446c0b4e-05fd-4dfc-9c6e-410cf9944d2e","Type":"ContainerDied","Data":"80055822976af62ef493f617e31acbe9b4392328becca0c0859acfe246ef5804"}
Aug 04 00:31:57.836991 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:31:57.836816    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80055822976af62ef493f617e31acbe9b4392328becca0c0859acfe246ef5804"
Aug 04 00:32:01.190933 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:01.190894    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1c5d1257-frlq5"]
Aug 04 00:32:01.196006 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:01.195978    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1c5d1257-frlq5"]
Aug 04 00:32:01.335290 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:01.335262    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"]
Aug 04 00:32:01.335521 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:01.335495    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw" podUID="ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" containerName="istio-proxy" containerID="cri-o://467b97f80c2bbea5a75f89f5b61f5444d34510baf3c94858ae05e0456837f2e0" gracePeriod=30
Aug 04 00:32:02.308765 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:02.308704    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="446c0b4e-05fd-4dfc-9c6e-410cf9944d2e" path="/var/lib/kubelet/pods/446c0b4e-05fd-4dfc-9c6e-410cf9944d2e/volumes"
Aug 04 00:32:05.588274 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:05.588243    2556 patch_prober.go:28] interesting pod/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 00:32:05.588648 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:05.588299    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw" podUID="ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 00:32:06.580193 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.580168    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:32:06.729426 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.729324    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-workload-certs\") pod \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") "
Aug 04 00:32:06.729426 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.729411    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-credential-socket\") pod \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") "
Aug 04 00:32:06.729976 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.729444    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-workload-socket\") pod \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") "
Aug 04 00:32:06.729976 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.729472    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istio-token\") pod \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") "
Aug 04 00:32:06.729976 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.729509    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istio-envoy\") pod \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") "
Aug 04 00:32:06.729976 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.729541    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istio-podinfo\") pod \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") "
Aug 04 00:32:06.729976 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.729598    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istio-data\") pod \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") "
Aug 04 00:32:06.729976 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.729651    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istiod-ca-cert\") pod \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") "
Aug 04 00:32:06.729976 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.729690    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jm9qf\" (UniqueName: \"kubernetes.io/projected/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-kube-api-access-jm9qf\") pod \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\" (UID: \"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd\") "
Aug 04 00:32:06.729976 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.729781    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" (UID: "ed601dd9-704a-4149-88c0-d3c7a3c9b5dd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:32:06.729976 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.729945    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istio-data" (OuterVolumeSpecName: "istio-data") pod "ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" (UID: "ed601dd9-704a-4149-88c0-d3c7a3c9b5dd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:32:06.729976 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.729962    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" (UID: "ed601dd9-704a-4149-88c0-d3c7a3c9b5dd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:32:06.730517 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.730034    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" (UID: "ed601dd9-704a-4149-88c0-d3c7a3c9b5dd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:32:06.730517 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.730138    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-workload-certs\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:32:06.730517 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.730156    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-credential-socket\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:32:06.730517 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.730172    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-workload-socket\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:32:06.730517 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.730186    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istio-data\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:32:06.730517 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.730263    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" (UID: "ed601dd9-704a-4149-88c0-d3c7a3c9b5dd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:32:06.732320 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.732288    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-kube-api-access-jm9qf" (OuterVolumeSpecName: "kube-api-access-jm9qf") pod "ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" (UID: "ed601dd9-704a-4149-88c0-d3c7a3c9b5dd"). InnerVolumeSpecName "kube-api-access-jm9qf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:32:06.732432 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.732341    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" (UID: "ed601dd9-704a-4149-88c0-d3c7a3c9b5dd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:32:06.732432 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.732355    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istio-token" (OuterVolumeSpecName: "istio-token") pod "ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" (UID: "ed601dd9-704a-4149-88c0-d3c7a3c9b5dd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:32:06.732432 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.732343    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" (UID: "ed601dd9-704a-4149-88c0-d3c7a3c9b5dd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 00:32:06.831443 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.831409    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istio-podinfo\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:32:06.831443 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.831436    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istiod-ca-cert\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:32:06.831443 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.831446    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jm9qf\" (UniqueName: \"kubernetes.io/projected/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-kube-api-access-jm9qf\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:32:06.831683 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.831457    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istio-token\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:32:06.831683 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.831469    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd-istio-envoy\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:32:06.882339 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.882308    2556 generic.go:356] "Generic (PLEG): container finished" podID="ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" containerID="467b97f80c2bbea5a75f89f5b61f5444d34510baf3c94858ae05e0456837f2e0" exitCode=0
Aug 04 00:32:06.882513 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.882359    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"
Aug 04 00:32:06.882513 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.882394    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw" event={"ID":"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd","Type":"ContainerDied","Data":"467b97f80c2bbea5a75f89f5b61f5444d34510baf3c94858ae05e0456837f2e0"}
Aug 04 00:32:06.882513 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.882452    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw" event={"ID":"ed601dd9-704a-4149-88c0-d3c7a3c9b5dd","Type":"ContainerDied","Data":"1702fced352023e15f230e307c86f4b65b5bfb68d5c329d281482c2e8603fdf6"}
Aug 04 00:32:06.882513 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.882485    2556 scope.go:117] "RemoveContainer" containerID="467b97f80c2bbea5a75f89f5b61f5444d34510baf3c94858ae05e0456837f2e0"
Aug 04 00:32:06.892259 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.892242    2556 scope.go:117] "RemoveContainer" containerID="c8ef78bc13c3188d36a0791f14f23044b4fbb4f35666d736a34a1c30818daab8"
Aug 04 00:32:06.902154 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.902123    2556 scope.go:117] "RemoveContainer" containerID="467b97f80c2bbea5a75f89f5b61f5444d34510baf3c94858ae05e0456837f2e0"
Aug 04 00:32:06.902870 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:32:06.902837    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"467b97f80c2bbea5a75f89f5b61f5444d34510baf3c94858ae05e0456837f2e0\": container with ID starting with 467b97f80c2bbea5a75f89f5b61f5444d34510baf3c94858ae05e0456837f2e0 not found: ID does not exist" containerID="467b97f80c2bbea5a75f89f5b61f5444d34510baf3c94858ae05e0456837f2e0"
Aug 04 00:32:06.902986 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.902879    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"467b97f80c2bbea5a75f89f5b61f5444d34510baf3c94858ae05e0456837f2e0"} err="failed to get container status \"467b97f80c2bbea5a75f89f5b61f5444d34510baf3c94858ae05e0456837f2e0\": rpc error: code = NotFound desc = could not find container \"467b97f80c2bbea5a75f89f5b61f5444d34510baf3c94858ae05e0456837f2e0\": container with ID starting with 467b97f80c2bbea5a75f89f5b61f5444d34510baf3c94858ae05e0456837f2e0 not found: ID does not exist"
Aug 04 00:32:06.902986 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.902906    2556 scope.go:117] "RemoveContainer" containerID="c8ef78bc13c3188d36a0791f14f23044b4fbb4f35666d736a34a1c30818daab8"
Aug 04 00:32:06.903458 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:32:06.903436    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8ef78bc13c3188d36a0791f14f23044b4fbb4f35666d736a34a1c30818daab8\": container with ID starting with c8ef78bc13c3188d36a0791f14f23044b4fbb4f35666d736a34a1c30818daab8 not found: ID does not exist" containerID="c8ef78bc13c3188d36a0791f14f23044b4fbb4f35666d736a34a1c30818daab8"
Aug 04 00:32:06.903542 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.903464    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8ef78bc13c3188d36a0791f14f23044b4fbb4f35666d736a34a1c30818daab8"} err="failed to get container status \"c8ef78bc13c3188d36a0791f14f23044b4fbb4f35666d736a34a1c30818daab8\": rpc error: code = NotFound desc = could not find container \"c8ef78bc13c3188d36a0791f14f23044b4fbb4f35666d736a34a1c30818daab8\": container with ID starting with c8ef78bc13c3188d36a0791f14f23044b4fbb4f35666d736a34a1c30818daab8 not found: ID does not exist"
Aug 04 00:32:06.904699 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.904678    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"]
Aug 04 00:32:06.909683 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:06.909662    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1c5d1257-openshift-default-56fc8869b-8kjnw"]
Aug 04 00:32:08.308043 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:08.308008    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" path="/var/lib/kubelet/pods/ed601dd9-704a-4149-88c0-d3c7a3c9b5dd/volumes"
Aug 04 00:32:26.351551 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:26.351517    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:32:26.356335 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:26.356315    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:32:29.401965 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:29.401937    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f75963-pbmnn"]
Aug 04 00:32:29.402346 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:29.402318    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="446c0b4e-05fd-4dfc-9c6e-410cf9944d2e" containerName="revoke-keys"
Aug 04 00:32:29.402346 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:29.402328    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="446c0b4e-05fd-4dfc-9c6e-410cf9944d2e" containerName="revoke-keys"
Aug 04 00:32:29.402346 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:29.402339    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" containerName="istio-proxy"
Aug 04 00:32:29.402346 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:29.402344    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" containerName="istio-proxy"
Aug 04 00:32:29.402480 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:29.402353    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" containerName="istio-proxy"
Aug 04 00:32:29.402480 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:29.402359    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" containerName="istio-proxy"
Aug 04 00:32:29.402480 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:29.402422    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="446c0b4e-05fd-4dfc-9c6e-410cf9944d2e" containerName="revoke-keys"
Aug 04 00:32:29.402480 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:29.402430    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" containerName="istio-proxy"
Aug 04 00:32:29.402480 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:29.402436    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed601dd9-704a-4149-88c0-d3c7a3c9b5dd" containerName="istio-proxy"
Aug 04 00:32:29.405363 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:29.405347    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f75963-pbmnn"
Aug 04 00:32:29.407608 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:29.407587    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8db7m\""
Aug 04 00:32:29.412146 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:29.412115    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f75963-pbmnn"]
Aug 04 00:32:29.554265 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:29.554231    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf0e34d3-40d8-44d3-9714-41706d73079e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-41f75963-pbmnn\" (UID: \"bf0e34d3-40d8-44d3-9714-41706d73079e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f75963-pbmnn"
Aug 04 00:32:29.654874 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:29.654794    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf0e34d3-40d8-44d3-9714-41706d73079e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-41f75963-pbmnn\" (UID: \"bf0e34d3-40d8-44d3-9714-41706d73079e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f75963-pbmnn"
Aug 04 00:32:29.655376 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:29.655355    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf0e34d3-40d8-44d3-9714-41706d73079e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-41f75963-pbmnn\" (UID: \"bf0e34d3-40d8-44d3-9714-41706d73079e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f75963-pbmnn"
Aug 04 00:32:29.716855 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:29.716832    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f75963-pbmnn"
Aug 04 00:32:29.845115 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:29.845089    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f75963-pbmnn"]
Aug 04 00:32:29.847819 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:32:29.847794    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf0e34d3_40d8_44d3_9714_41706d73079e.slice/crio-2ad25b9be899b6dec623ccb55475da32efefa593faa0d3c31b7851fc8b9e72ea WatchSource:0}: Error finding container 2ad25b9be899b6dec623ccb55475da32efefa593faa0d3c31b7851fc8b9e72ea: Status 404 returned error can't find the container with id 2ad25b9be899b6dec623ccb55475da32efefa593faa0d3c31b7851fc8b9e72ea
Aug 04 00:32:29.993442 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:29.993362    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f75963-pbmnn" event={"ID":"bf0e34d3-40d8-44d3-9714-41706d73079e","Type":"ContainerStarted","Data":"2ad25b9be899b6dec623ccb55475da32efefa593faa0d3c31b7851fc8b9e72ea"}
Aug 04 00:32:30.999868 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:30.999785    2556 generic.go:356] "Generic (PLEG): container finished" podID="bf0e34d3-40d8-44d3-9714-41706d73079e" containerID="fc569745ff3a1fe79293564f0f4e0af6a8828fdd28d2b0997d0e895641692c87" exitCode=0
Aug 04 00:32:30.999868 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:30.999838    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f75963-pbmnn" event={"ID":"bf0e34d3-40d8-44d3-9714-41706d73079e","Type":"ContainerDied","Data":"fc569745ff3a1fe79293564f0f4e0af6a8828fdd28d2b0997d0e895641692c87"}
Aug 04 00:32:32.147202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:32.147179    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f75963-pbmnn"
Aug 04 00:32:32.279053 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:32.278976    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf0e34d3-40d8-44d3-9714-41706d73079e-maas-api-service-ca\") pod \"bf0e34d3-40d8-44d3-9714-41706d73079e\" (UID: \"bf0e34d3-40d8-44d3-9714-41706d73079e\") "
Aug 04 00:32:32.279269 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:32.279246    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf0e34d3-40d8-44d3-9714-41706d73079e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bf0e34d3-40d8-44d3-9714-41706d73079e" (UID: "bf0e34d3-40d8-44d3-9714-41706d73079e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:32:32.379642 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:32.379614    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf0e34d3-40d8-44d3-9714-41706d73079e-maas-api-service-ca\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:32:33.010020 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:33.009990    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f75963-pbmnn"
Aug 04 00:32:33.010190 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:33.010022    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f75963-pbmnn" event={"ID":"bf0e34d3-40d8-44d3-9714-41706d73079e","Type":"ContainerDied","Data":"2ad25b9be899b6dec623ccb55475da32efefa593faa0d3c31b7851fc8b9e72ea"}
Aug 04 00:32:33.010190 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:33.010067    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ad25b9be899b6dec623ccb55475da32efefa593faa0d3c31b7851fc8b9e72ea"
Aug 04 00:32:36.140419 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:36.140385    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f75963-pbmnn"]
Aug 04 00:32:36.142842 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:36.142817    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f75963-pbmnn"]
Aug 04 00:32:36.308985 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:36.308951    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf0e34d3-40d8-44d3-9714-41706d73079e" path="/var/lib/kubelet/pods/bf0e34d3-40d8-44d3-9714-41706d73079e/volumes"
Aug 04 00:32:37.013210 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.013177    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"]
Aug 04 00:32:37.013573 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.013560    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf0e34d3-40d8-44d3-9714-41706d73079e" containerName="revoke-keys"
Aug 04 00:32:37.013650 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.013574    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf0e34d3-40d8-44d3-9714-41706d73079e" containerName="revoke-keys"
Aug 04 00:32:37.013701 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.013657    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf0e34d3-40d8-44d3-9714-41706d73079e" containerName="revoke-keys"
Aug 04 00:32:37.016886 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.016870    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.019236 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.019214    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-fb51014a-openshift-default-dockercfg-cgrs5\""
Aug 04 00:32:37.027065 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.027040    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"]
Aug 04 00:32:37.120131 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.120102    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpnkj\" (UniqueName: \"kubernetes.io/projected/021d3cae-a811-483a-b1b3-d615e624c63f-kube-api-access-hpnkj\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.120131 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.120136    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-workload-socket\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.120352 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.120172    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-istio-envoy\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.120352 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.120273    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-workload-certs\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.120352 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.120301    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/021d3cae-a811-483a-b1b3-d615e624c63f-istiod-ca-cert\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.120352 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.120318    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/021d3cae-a811-483a-b1b3-d615e624c63f-istio-token\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.120580 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.120378    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-istio-data\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.120580 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.120460    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-credential-socket\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.120580 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.120478    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/021d3cae-a811-483a-b1b3-d615e624c63f-istio-podinfo\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.221660 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.221626    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-istio-envoy\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.222108 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.221688    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-workload-certs\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.222108 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.221705    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/021d3cae-a811-483a-b1b3-d615e624c63f-istiod-ca-cert\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.222108 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.221751    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/021d3cae-a811-483a-b1b3-d615e624c63f-istio-token\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.222108 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.221836    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-istio-data\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.222108 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.221876    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-credential-socket\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.222108 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.221901    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/021d3cae-a811-483a-b1b3-d615e624c63f-istio-podinfo\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.222108 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.221969    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpnkj\" (UniqueName: \"kubernetes.io/projected/021d3cae-a811-483a-b1b3-d615e624c63f-kube-api-access-hpnkj\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.222108 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.221997    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-workload-socket\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.222538 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.222170    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-workload-certs\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.222538 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.222276    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-credential-socket\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.222538 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.222302    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-istio-data\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.222538 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.222401    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-workload-socket\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.222538 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.222529    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/021d3cae-a811-483a-b1b3-d615e624c63f-istiod-ca-cert\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.224009 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.223990    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-istio-envoy\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.224304 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.224287    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/021d3cae-a811-483a-b1b3-d615e624c63f-istio-podinfo\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.229392 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.229366    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/021d3cae-a811-483a-b1b3-d615e624c63f-istio-token\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.229992 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.229971    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpnkj\" (UniqueName: \"kubernetes.io/projected/021d3cae-a811-483a-b1b3-d615e624c63f-kube-api-access-hpnkj\") pod \"e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") " pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.328925 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.328843    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:37.464683 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.464653    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"]
Aug 04 00:32:37.468209 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:32:37.468178    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod021d3cae_a811_483a_b1b3_d615e624c63f.slice/crio-337634aa596e2a539a799f2a085a4f7e055132dcd3c4d3a3f68493856ab48b7e WatchSource:0}: Error finding container 337634aa596e2a539a799f2a085a4f7e055132dcd3c4d3a3f68493856ab48b7e: Status 404 returned error can't find the container with id 337634aa596e2a539a799f2a085a4f7e055132dcd3c4d3a3f68493856ab48b7e
Aug 04 00:32:37.470258 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.470224    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:32:37.470372 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.470287    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:32:37.470372 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:37.470356    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:32:38.041354 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:38.041319    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf" event={"ID":"021d3cae-a811-483a-b1b3-d615e624c63f","Type":"ContainerStarted","Data":"2835e59f7d8ce501175e7949d02c9814f43861d74f71a3f9c000dcd9f6aa812a"}
Aug 04 00:32:38.041540 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:38.041373    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf" event={"ID":"021d3cae-a811-483a-b1b3-d615e624c63f","Type":"ContainerStarted","Data":"337634aa596e2a539a799f2a085a4f7e055132dcd3c4d3a3f68493856ab48b7e"}
Aug 04 00:32:38.062526 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:38.062472    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf" podStartSLOduration=2.062455019 podStartE2EDuration="2.062455019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:32:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:32:38.060902963 +0000 UTC m=+1812.229540333" watchObservedRunningTime="2026-08-04 00:32:38.062455019 +0000 UTC m=+1812.231092469"
Aug 04 00:32:38.329266 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:38.329178    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:38.334037 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:38.334013    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:39.046891 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:39.046855    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:39.047709 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:39.047689    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:53.120793 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:53.120756    2556 generic.go:356] "Generic (PLEG): container finished" podID="021d3cae-a811-483a-b1b3-d615e624c63f" containerID="2835e59f7d8ce501175e7949d02c9814f43861d74f71a3f9c000dcd9f6aa812a" exitCode=0
Aug 04 00:32:53.121195 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:53.120830    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf" event={"ID":"021d3cae-a811-483a-b1b3-d615e624c63f","Type":"ContainerDied","Data":"2835e59f7d8ce501175e7949d02c9814f43861d74f71a3f9c000dcd9f6aa812a"}
Aug 04 00:32:53.121241 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:53.121201    2556 scope.go:117] "RemoveContainer" containerID="2835e59f7d8ce501175e7949d02c9814f43861d74f71a3f9c000dcd9f6aa812a"
Aug 04 00:32:53.122189 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:53.122164    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:32:53.122265 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:53.122225    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:32:53.122265 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:53.122256    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:32:54.047173 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:54.047128    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:54.127833 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:54.127797    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf" event={"ID":"021d3cae-a811-483a-b1b3-d615e624c63f","Type":"ContainerStarted","Data":"130c3a467f622f4a01dc37c1be5a6951cf5313dbcafefb22102225ed3deccd0f"}
Aug 04 00:32:54.329585 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:54.329506    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:54.330480 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:54.330451    2556 patch_prober.go:28] interesting pod/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Aug 04 00:32:54.330648 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:54.330507    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf" podUID="021d3cae-a811-483a-b1b3-d615e624c63f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Aug 04 00:32:55.329489 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:55.329354    2556 patch_prober.go:28] interesting pod/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Aug 04 00:32:55.329489 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:55.329408    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf" podUID="021d3cae-a811-483a-b1b3-d615e624c63f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Aug 04 00:32:56.329906 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:56.329878    2556 patch_prober.go:28] interesting pod/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Aug 04 00:32:56.330419 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:56.330381    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf" podUID="021d3cae-a811-483a-b1b3-d615e624c63f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Aug 04 00:32:57.329305 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:57.329272    2556 patch_prober.go:28] interesting pod/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Aug 04 00:32:57.329480 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:57.329318    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf" podUID="021d3cae-a811-483a-b1b3-d615e624c63f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Aug 04 00:32:58.329367 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:58.329340    2556 patch_prober.go:28] interesting pod/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Aug 04 00:32:58.329816 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:58.329790    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf" podUID="021d3cae-a811-483a-b1b3-d615e624c63f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Aug 04 00:32:59.333785 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:59.333756    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:59.334139 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:59.334042    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:32:59.334640 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:32:59.334611    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:33:05.202097 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:05.202068    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb51014a-4mbhg"]
Aug 04 00:33:05.205611 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:05.205591    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb51014a-4mbhg"
Aug 04 00:33:05.208357 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:05.208335    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8db7m\""
Aug 04 00:33:05.214022 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:05.213998    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb51014a-4mbhg"]
Aug 04 00:33:05.296111 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:05.296078    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/977ca81a-48e7-4bc1-a064-d6281aca4faa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fb51014a-4mbhg\" (UID: \"977ca81a-48e7-4bc1-a064-d6281aca4faa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb51014a-4mbhg"
Aug 04 00:33:05.396734 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:05.396691    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/977ca81a-48e7-4bc1-a064-d6281aca4faa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fb51014a-4mbhg\" (UID: \"977ca81a-48e7-4bc1-a064-d6281aca4faa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb51014a-4mbhg"
Aug 04 00:33:05.397267 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:05.397250    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/977ca81a-48e7-4bc1-a064-d6281aca4faa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fb51014a-4mbhg\" (UID: \"977ca81a-48e7-4bc1-a064-d6281aca4faa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb51014a-4mbhg"
Aug 04 00:33:05.517308 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:05.517282    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb51014a-4mbhg"
Aug 04 00:33:05.647725 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:05.647687    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb51014a-4mbhg"]
Aug 04 00:33:05.649533 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:33:05.649504    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod977ca81a_48e7_4bc1_a064_d6281aca4faa.slice/crio-0263624442af4ec419eac90ad1e5cbce6c89bce1118b4d6e171b617d7000dd3a WatchSource:0}: Error finding container 0263624442af4ec419eac90ad1e5cbce6c89bce1118b4d6e171b617d7000dd3a: Status 404 returned error can't find the container with id 0263624442af4ec419eac90ad1e5cbce6c89bce1118b4d6e171b617d7000dd3a
Aug 04 00:33:06.191086 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:06.190990    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb51014a-4mbhg" event={"ID":"977ca81a-48e7-4bc1-a064-d6281aca4faa","Type":"ContainerStarted","Data":"938a38d90bac0aecf5227b2d901cf0b3cc1878ab172c17a39e677a2c3e4a926a"}
Aug 04 00:33:06.191256 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:06.191090    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb51014a-4mbhg" event={"ID":"977ca81a-48e7-4bc1-a064-d6281aca4faa","Type":"ContainerStarted","Data":"0263624442af4ec419eac90ad1e5cbce6c89bce1118b4d6e171b617d7000dd3a"}
Aug 04 00:33:06.208811 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:06.208768    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb51014a-4mbhg" podStartSLOduration=1.208751867 podStartE2EDuration="1.208751867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:33:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:33:06.207987727 +0000 UTC m=+1840.376625097" watchObservedRunningTime="2026-08-04 00:33:06.208751867 +0000 UTC m=+1840.377389236"
Aug 04 00:33:07.197294 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:07.197254    2556 generic.go:356] "Generic (PLEG): container finished" podID="977ca81a-48e7-4bc1-a064-d6281aca4faa" containerID="938a38d90bac0aecf5227b2d901cf0b3cc1878ab172c17a39e677a2c3e4a926a" exitCode=0
Aug 04 00:33:07.197471 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:07.197335    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb51014a-4mbhg" event={"ID":"977ca81a-48e7-4bc1-a064-d6281aca4faa","Type":"ContainerDied","Data":"938a38d90bac0aecf5227b2d901cf0b3cc1878ab172c17a39e677a2c3e4a926a"}
Aug 04 00:33:08.343057 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:08.343034    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb51014a-4mbhg"
Aug 04 00:33:08.427284 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:08.427253    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/977ca81a-48e7-4bc1-a064-d6281aca4faa-maas-api-service-ca\") pod \"977ca81a-48e7-4bc1-a064-d6281aca4faa\" (UID: \"977ca81a-48e7-4bc1-a064-d6281aca4faa\") "
Aug 04 00:33:08.427637 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:08.427613    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/977ca81a-48e7-4bc1-a064-d6281aca4faa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "977ca81a-48e7-4bc1-a064-d6281aca4faa" (UID: "977ca81a-48e7-4bc1-a064-d6281aca4faa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:33:08.528878 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:08.528846    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/977ca81a-48e7-4bc1-a064-d6281aca4faa-maas-api-service-ca\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:33:09.208458 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:09.208429    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb51014a-4mbhg"
Aug 04 00:33:09.208655 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:09.208431    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb51014a-4mbhg" event={"ID":"977ca81a-48e7-4bc1-a064-d6281aca4faa","Type":"ContainerDied","Data":"0263624442af4ec419eac90ad1e5cbce6c89bce1118b4d6e171b617d7000dd3a"}
Aug 04 00:33:09.208655 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:09.208547    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0263624442af4ec419eac90ad1e5cbce6c89bce1118b4d6e171b617d7000dd3a"
Aug 04 00:33:11.174517 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:11.174482    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb51014a-4mbhg"]
Aug 04 00:33:11.177331 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:11.177294    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb51014a-4mbhg"]
Aug 04 00:33:12.247845 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:12.247812    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"]
Aug 04 00:33:12.248304 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:12.248094    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf" podUID="021d3cae-a811-483a-b1b3-d615e624c63f" containerName="istio-proxy" containerID="cri-o://130c3a467f622f4a01dc37c1be5a6951cf5313dbcafefb22102225ed3deccd0f" gracePeriod=30
Aug 04 00:33:12.307170 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:12.307127    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="977ca81a-48e7-4bc1-a064-d6281aca4faa" path="/var/lib/kubelet/pods/977ca81a-48e7-4bc1-a064-d6281aca4faa/volumes"
Aug 04 00:33:14.336473 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:14.336438    2556 patch_prober.go:28] interesting pod/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 00:33:14.336875 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:14.336509    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf" podUID="021d3cae-a811-483a-b1b3-d615e624c63f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 00:33:17.499741 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.499704    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:33:17.616851 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.616758    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-credential-socket\") pod \"021d3cae-a811-483a-b1b3-d615e624c63f\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") "
Aug 04 00:33:17.616851 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.616809    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/021d3cae-a811-483a-b1b3-d615e624c63f-istiod-ca-cert\") pod \"021d3cae-a811-483a-b1b3-d615e624c63f\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") "
Aug 04 00:33:17.616851 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.616842    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/021d3cae-a811-483a-b1b3-d615e624c63f-istio-podinfo\") pod \"021d3cae-a811-483a-b1b3-d615e624c63f\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") "
Aug 04 00:33:17.617138 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.616858    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-istio-envoy\") pod \"021d3cae-a811-483a-b1b3-d615e624c63f\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") "
Aug 04 00:33:17.617138 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.616898    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-workload-certs\") pod \"021d3cae-a811-483a-b1b3-d615e624c63f\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") "
Aug 04 00:33:17.617138 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.616985    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-workload-socket\") pod \"021d3cae-a811-483a-b1b3-d615e624c63f\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") "
Aug 04 00:33:17.617138 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.617083    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/021d3cae-a811-483a-b1b3-d615e624c63f-istio-token\") pod \"021d3cae-a811-483a-b1b3-d615e624c63f\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") "
Aug 04 00:33:17.617138 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.617118    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-istio-data\") pod \"021d3cae-a811-483a-b1b3-d615e624c63f\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") "
Aug 04 00:33:17.617138 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.617115    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "021d3cae-a811-483a-b1b3-d615e624c63f" (UID: "021d3cae-a811-483a-b1b3-d615e624c63f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:33:17.617513 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.617163    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpnkj\" (UniqueName: \"kubernetes.io/projected/021d3cae-a811-483a-b1b3-d615e624c63f-kube-api-access-hpnkj\") pod \"021d3cae-a811-483a-b1b3-d615e624c63f\" (UID: \"021d3cae-a811-483a-b1b3-d615e624c63f\") "
Aug 04 00:33:17.617513 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.617284    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "021d3cae-a811-483a-b1b3-d615e624c63f" (UID: "021d3cae-a811-483a-b1b3-d615e624c63f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:33:17.617513 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.617379    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/021d3cae-a811-483a-b1b3-d615e624c63f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "021d3cae-a811-483a-b1b3-d615e624c63f" (UID: "021d3cae-a811-483a-b1b3-d615e624c63f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:33:17.617513 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.617392    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-istio-data" (OuterVolumeSpecName: "istio-data") pod "021d3cae-a811-483a-b1b3-d615e624c63f" (UID: "021d3cae-a811-483a-b1b3-d615e624c63f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:33:17.617695 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.617548    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "021d3cae-a811-483a-b1b3-d615e624c63f" (UID: "021d3cae-a811-483a-b1b3-d615e624c63f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:33:17.617695 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.617591    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-credential-socket\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:33:17.617695 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.617609    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/021d3cae-a811-483a-b1b3-d615e624c63f-istiod-ca-cert\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:33:17.617695 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.617622    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-workload-socket\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:33:17.617695 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.617636    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-istio-data\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:33:17.619766 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.619700    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/021d3cae-a811-483a-b1b3-d615e624c63f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "021d3cae-a811-483a-b1b3-d615e624c63f" (UID: "021d3cae-a811-483a-b1b3-d615e624c63f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 00:33:17.619905 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.619759    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/021d3cae-a811-483a-b1b3-d615e624c63f-istio-token" (OuterVolumeSpecName: "istio-token") pod "021d3cae-a811-483a-b1b3-d615e624c63f" (UID: "021d3cae-a811-483a-b1b3-d615e624c63f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:33:17.619905 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.619839    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/021d3cae-a811-483a-b1b3-d615e624c63f-kube-api-access-hpnkj" (OuterVolumeSpecName: "kube-api-access-hpnkj") pod "021d3cae-a811-483a-b1b3-d615e624c63f" (UID: "021d3cae-a811-483a-b1b3-d615e624c63f"). InnerVolumeSpecName "kube-api-access-hpnkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:33:17.619905 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.619871    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "021d3cae-a811-483a-b1b3-d615e624c63f" (UID: "021d3cae-a811-483a-b1b3-d615e624c63f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:33:17.718357 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.718324    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/021d3cae-a811-483a-b1b3-d615e624c63f-istio-token\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:33:17.718357 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.718352    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpnkj\" (UniqueName: \"kubernetes.io/projected/021d3cae-a811-483a-b1b3-d615e624c63f-kube-api-access-hpnkj\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:33:17.718357 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.718362    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/021d3cae-a811-483a-b1b3-d615e624c63f-istio-podinfo\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:33:17.718616 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.718370    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-istio-envoy\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:33:17.718616 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:17.718379    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/021d3cae-a811-483a-b1b3-d615e624c63f-workload-certs\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:33:18.256241 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:18.256203    2556 generic.go:356] "Generic (PLEG): container finished" podID="021d3cae-a811-483a-b1b3-d615e624c63f" containerID="130c3a467f622f4a01dc37c1be5a6951cf5313dbcafefb22102225ed3deccd0f" exitCode=0
Aug 04 00:33:18.256414 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:18.256268    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"
Aug 04 00:33:18.256414 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:18.256287    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf" event={"ID":"021d3cae-a811-483a-b1b3-d615e624c63f","Type":"ContainerDied","Data":"130c3a467f622f4a01dc37c1be5a6951cf5313dbcafefb22102225ed3deccd0f"}
Aug 04 00:33:18.256414 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:18.256375    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf" event={"ID":"021d3cae-a811-483a-b1b3-d615e624c63f","Type":"ContainerDied","Data":"337634aa596e2a539a799f2a085a4f7e055132dcd3c4d3a3f68493856ab48b7e"}
Aug 04 00:33:18.256414 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:18.256404    2556 scope.go:117] "RemoveContainer" containerID="130c3a467f622f4a01dc37c1be5a6951cf5313dbcafefb22102225ed3deccd0f"
Aug 04 00:33:18.267454 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:18.267438    2556 scope.go:117] "RemoveContainer" containerID="2835e59f7d8ce501175e7949d02c9814f43861d74f71a3f9c000dcd9f6aa812a"
Aug 04 00:33:18.275895 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:18.275875    2556 scope.go:117] "RemoveContainer" containerID="130c3a467f622f4a01dc37c1be5a6951cf5313dbcafefb22102225ed3deccd0f"
Aug 04 00:33:18.276143 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:33:18.276123    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"130c3a467f622f4a01dc37c1be5a6951cf5313dbcafefb22102225ed3deccd0f\": container with ID starting with 130c3a467f622f4a01dc37c1be5a6951cf5313dbcafefb22102225ed3deccd0f not found: ID does not exist" containerID="130c3a467f622f4a01dc37c1be5a6951cf5313dbcafefb22102225ed3deccd0f"
Aug 04 00:33:18.276219 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:18.276156    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"130c3a467f622f4a01dc37c1be5a6951cf5313dbcafefb22102225ed3deccd0f"} err="failed to get container status \"130c3a467f622f4a01dc37c1be5a6951cf5313dbcafefb22102225ed3deccd0f\": rpc error: code = NotFound desc = could not find container \"130c3a467f622f4a01dc37c1be5a6951cf5313dbcafefb22102225ed3deccd0f\": container with ID starting with 130c3a467f622f4a01dc37c1be5a6951cf5313dbcafefb22102225ed3deccd0f not found: ID does not exist"
Aug 04 00:33:18.276219 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:18.276181    2556 scope.go:117] "RemoveContainer" containerID="2835e59f7d8ce501175e7949d02c9814f43861d74f71a3f9c000dcd9f6aa812a"
Aug 04 00:33:18.276398 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:33:18.276383    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2835e59f7d8ce501175e7949d02c9814f43861d74f71a3f9c000dcd9f6aa812a\": container with ID starting with 2835e59f7d8ce501175e7949d02c9814f43861d74f71a3f9c000dcd9f6aa812a not found: ID does not exist" containerID="2835e59f7d8ce501175e7949d02c9814f43861d74f71a3f9c000dcd9f6aa812a"
Aug 04 00:33:18.276438 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:18.276405    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2835e59f7d8ce501175e7949d02c9814f43861d74f71a3f9c000dcd9f6aa812a"} err="failed to get container status \"2835e59f7d8ce501175e7949d02c9814f43861d74f71a3f9c000dcd9f6aa812a\": rpc error: code = NotFound desc = could not find container \"2835e59f7d8ce501175e7949d02c9814f43861d74f71a3f9c000dcd9f6aa812a\": container with ID starting with 2835e59f7d8ce501175e7949d02c9814f43861d74f71a3f9c000dcd9f6aa812a not found: ID does not exist"
Aug 04 00:33:18.281311 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:18.281289    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"]
Aug 04 00:33:18.285251 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:18.285231    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-fb51014a-openshift-default-5776b8b84d-q7bcf"]
Aug 04 00:33:18.307556 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:18.307520    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="021d3cae-a811-483a-b1b3-d615e624c63f" path="/var/lib/kubelet/pods/021d3cae-a811-483a-b1b3-d615e624c63f/volumes"
Aug 04 00:33:40.688758 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:40.683362    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-59a98a02-svs4n"]
Aug 04 00:33:40.688758 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:40.684291    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="977ca81a-48e7-4bc1-a064-d6281aca4faa" containerName="revoke-keys"
Aug 04 00:33:40.688758 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:40.684312    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="977ca81a-48e7-4bc1-a064-d6281aca4faa" containerName="revoke-keys"
Aug 04 00:33:40.688758 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:40.684371    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="021d3cae-a811-483a-b1b3-d615e624c63f" containerName="istio-proxy"
Aug 04 00:33:40.688758 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:40.684380    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="021d3cae-a811-483a-b1b3-d615e624c63f" containerName="istio-proxy"
Aug 04 00:33:40.688758 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:40.684399    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="021d3cae-a811-483a-b1b3-d615e624c63f" containerName="istio-proxy"
Aug 04 00:33:40.688758 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:40.684407    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="021d3cae-a811-483a-b1b3-d615e624c63f" containerName="istio-proxy"
Aug 04 00:33:40.688758 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:40.684568    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="021d3cae-a811-483a-b1b3-d615e624c63f" containerName="istio-proxy"
Aug 04 00:33:40.688758 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:40.684587    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="977ca81a-48e7-4bc1-a064-d6281aca4faa" containerName="revoke-keys"
Aug 04 00:33:40.688758 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:40.688494    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-59a98a02-svs4n"
Aug 04 00:33:40.691566 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:40.691537    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8db7m\""
Aug 04 00:33:40.693021 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:40.692993    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-59a98a02-svs4n"]
Aug 04 00:33:40.727522 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:40.727488    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4ba4ec1-b069-4b9a-a6e6-04789fc87552-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-59a98a02-svs4n\" (UID: \"c4ba4ec1-b069-4b9a-a6e6-04789fc87552\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-59a98a02-svs4n"
Aug 04 00:33:40.828937 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:40.828904    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4ba4ec1-b069-4b9a-a6e6-04789fc87552-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-59a98a02-svs4n\" (UID: \"c4ba4ec1-b069-4b9a-a6e6-04789fc87552\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-59a98a02-svs4n"
Aug 04 00:33:40.829427 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:40.829409    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4ba4ec1-b069-4b9a-a6e6-04789fc87552-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-59a98a02-svs4n\" (UID: \"c4ba4ec1-b069-4b9a-a6e6-04789fc87552\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-59a98a02-svs4n"
Aug 04 00:33:41.001842 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:41.001766    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-59a98a02-svs4n"
Aug 04 00:33:41.129791 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:41.129767    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-59a98a02-svs4n"]
Aug 04 00:33:41.131924 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:33:41.131896    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4ba4ec1_b069_4b9a_a6e6_04789fc87552.slice/crio-98b10d3b2fb580781e38dda4dfacfb78344c68176d1a746b94da110a2d4b1d59 WatchSource:0}: Error finding container 98b10d3b2fb580781e38dda4dfacfb78344c68176d1a746b94da110a2d4b1d59: Status 404 returned error can't find the container with id 98b10d3b2fb580781e38dda4dfacfb78344c68176d1a746b94da110a2d4b1d59
Aug 04 00:33:41.370782 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:41.370747    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-59a98a02-svs4n" event={"ID":"c4ba4ec1-b069-4b9a-a6e6-04789fc87552","Type":"ContainerStarted","Data":"98b10d3b2fb580781e38dda4dfacfb78344c68176d1a746b94da110a2d4b1d59"}
Aug 04 00:33:41.872725 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:33:41.872678    2556 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4ba4ec1_b069_4b9a_a6e6_04789fc87552.slice/crio-58c8dc78423fe15084d984fadd2cd57db4abe8804590f5669981f55994c4ad59.scope\": RecentStats: unable to find data in memory cache]"
Aug 04 00:33:42.376828 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:42.376790    2556 generic.go:356] "Generic (PLEG): container finished" podID="c4ba4ec1-b069-4b9a-a6e6-04789fc87552" containerID="58c8dc78423fe15084d984fadd2cd57db4abe8804590f5669981f55994c4ad59" exitCode=0
Aug 04 00:33:42.377000 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:42.376883    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-59a98a02-svs4n" event={"ID":"c4ba4ec1-b069-4b9a-a6e6-04789fc87552","Type":"ContainerDied","Data":"58c8dc78423fe15084d984fadd2cd57db4abe8804590f5669981f55994c4ad59"}
Aug 04 00:33:43.513750 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:43.513726    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-59a98a02-svs4n"
Aug 04 00:33:43.658606 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:43.658526    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4ba4ec1-b069-4b9a-a6e6-04789fc87552-maas-api-service-ca\") pod \"c4ba4ec1-b069-4b9a-a6e6-04789fc87552\" (UID: \"c4ba4ec1-b069-4b9a-a6e6-04789fc87552\") "
Aug 04 00:33:43.658902 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:43.658879    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4ba4ec1-b069-4b9a-a6e6-04789fc87552-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c4ba4ec1-b069-4b9a-a6e6-04789fc87552" (UID: "c4ba4ec1-b069-4b9a-a6e6-04789fc87552"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:33:43.759926 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:43.759898    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4ba4ec1-b069-4b9a-a6e6-04789fc87552-maas-api-service-ca\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:33:44.387982 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:44.387951    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-59a98a02-svs4n"
Aug 04 00:33:44.388153 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:44.387947    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-59a98a02-svs4n" event={"ID":"c4ba4ec1-b069-4b9a-a6e6-04789fc87552","Type":"ContainerDied","Data":"98b10d3b2fb580781e38dda4dfacfb78344c68176d1a746b94da110a2d4b1d59"}
Aug 04 00:33:44.388153 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:44.388089    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98b10d3b2fb580781e38dda4dfacfb78344c68176d1a746b94da110a2d4b1d59"
Aug 04 00:33:47.784654 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:47.784611    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-59a98a02-svs4n"]
Aug 04 00:33:47.787116 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:47.787088    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-59a98a02-svs4n"]
Aug 04 00:33:48.307611 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:33:48.307579    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4ba4ec1-b069-4b9a-a6e6-04789fc87552" path="/var/lib/kubelet/pods/c4ba4ec1-b069-4b9a-a6e6-04789fc87552/volumes"
Aug 04 00:35:45.933770 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:45.933705    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"]
Aug 04 00:35:45.935183 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:45.935150    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4ba4ec1-b069-4b9a-a6e6-04789fc87552" containerName="revoke-keys"
Aug 04 00:35:45.935351 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:45.935339    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4ba4ec1-b069-4b9a-a6e6-04789fc87552" containerName="revoke-keys"
Aug 04 00:35:45.935585 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:45.935566    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="021d3cae-a811-483a-b1b3-d615e624c63f" containerName="istio-proxy"
Aug 04 00:35:45.935696 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:45.935686    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4ba4ec1-b069-4b9a-a6e6-04789fc87552" containerName="revoke-keys"
Aug 04 00:35:45.944863 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:45.941213    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:45.946244 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:45.946015    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-1915a2d1-openshift-default-dockercfg-g9gj6\""
Aug 04 00:35:46.017784 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.017745    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istiod-ca-cert\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.017983 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.017812    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istio-envoy\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.017983 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.017862    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-workload-certs\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.017983 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.017917    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq74r\" (UniqueName: \"kubernetes.io/projected/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-kube-api-access-mq74r\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.017983 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.017952    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istio-podinfo\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.017983 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.017976    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istio-data\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.018221 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.018008    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istio-token\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.018221 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.018067    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-workload-socket\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.018221 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.018119    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-credential-socket\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.046235 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.046200    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"]
Aug 04 00:35:46.119447 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.119403    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-credential-socket\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.119619 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.119496    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istiod-ca-cert\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.119619 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.119531    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istio-envoy\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.119619 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.119575    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-workload-certs\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.119619 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.119606    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq74r\" (UniqueName: \"kubernetes.io/projected/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-kube-api-access-mq74r\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.119911 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.119636    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istio-podinfo\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.119911 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.119787    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istio-data\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.119911 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.119829    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istio-token\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.119911 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.119860    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-workload-socket\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.119911 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.119897    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-credential-socket\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.120163 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.120011    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-workload-certs\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.120218 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.120168    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istio-data\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.120218 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.120189    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-workload-socket\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.120477 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.120447    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istiod-ca-cert\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.122011 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.121988    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istio-envoy\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.122386 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.122368    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istio-podinfo\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.132285 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.132252    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq74r\" (UniqueName: \"kubernetes.io/projected/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-kube-api-access-mq74r\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.136042 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.136013    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istio-token\") pod \"e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") " pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.258516 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.258489    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:46.406565 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.406537    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"]
Aug 04 00:35:46.407277 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:35:46.407250    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44dbfbc0_de7e_4d9a_a505_ad3d1c524a74.slice/crio-152965415df18b4aef9abe5555554ecbdc3674420fbc96971a31fec6c4a3ea11 WatchSource:0}: Error finding container 152965415df18b4aef9abe5555554ecbdc3674420fbc96971a31fec6c4a3ea11: Status 404 returned error can't find the container with id 152965415df18b4aef9abe5555554ecbdc3674420fbc96971a31fec6c4a3ea11
Aug 04 00:35:46.409464 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.409424    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:35:46.409564 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.409512    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:35:46.409564 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:46.409555    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:35:47.021086 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:47.021045    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz" event={"ID":"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74","Type":"ContainerStarted","Data":"f29f546982658af5a8d9935dfdda99b059c4fa485caeb8edc8e59ed28d864b1e"}
Aug 04 00:35:47.021545 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:47.021128    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz" event={"ID":"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74","Type":"ContainerStarted","Data":"152965415df18b4aef9abe5555554ecbdc3674420fbc96971a31fec6c4a3ea11"}
Aug 04 00:35:47.045973 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:47.045914    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz" podStartSLOduration=2.045898496 podStartE2EDuration="2.045898496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:35:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:35:47.043178253 +0000 UTC m=+2001.211815626" watchObservedRunningTime="2026-08-04 00:35:47.045898496 +0000 UTC m=+2001.214535866"
Aug 04 00:35:47.259022 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:47.258982    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:47.264042 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:47.264016    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:48.026824 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:48.026791    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:35:48.027879 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:35:48.027854    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:36:03.027936 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:03.027902    2556 patch_prober.go:28] interesting pod/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Aug 04 00:36:03.028431 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:03.027965    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz" podUID="44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Aug 04 00:36:03.109752 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:03.109699    2556 generic.go:356] "Generic (PLEG): container finished" podID="44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" containerID="f29f546982658af5a8d9935dfdda99b059c4fa485caeb8edc8e59ed28d864b1e" exitCode=0
Aug 04 00:36:03.109915 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:03.109764    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz" event={"ID":"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74","Type":"ContainerDied","Data":"f29f546982658af5a8d9935dfdda99b059c4fa485caeb8edc8e59ed28d864b1e"}
Aug 04 00:36:03.110135 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:03.110121    2556 scope.go:117] "RemoveContainer" containerID="f29f546982658af5a8d9935dfdda99b059c4fa485caeb8edc8e59ed28d864b1e"
Aug 04 00:36:03.111121 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:03.111093    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:36:03.111187 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:03.111160    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:36:03.111224 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:03.111207    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:36:04.116936 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:04.116901    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz" event={"ID":"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74","Type":"ContainerStarted","Data":"084d16393b2601f8f5df255695a682e1a20fbcf7f4e3313fff41a47cc1996331"}
Aug 04 00:36:04.258934 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:04.258889    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:36:04.259210 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:04.259180    2556 patch_prober.go:28] interesting pod/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Aug 04 00:36:04.259310 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:04.259277    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz" podUID="44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Aug 04 00:36:05.259349 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:05.259313    2556 patch_prober.go:28] interesting pod/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Aug 04 00:36:05.259863 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:05.259377    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz" podUID="44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Aug 04 00:36:06.260203 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:06.259766    2556 patch_prober.go:28] interesting pod/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Aug 04 00:36:06.260203 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:06.259826    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz" podUID="44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Aug 04 00:36:07.259498 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:07.259456    2556 patch_prober.go:28] interesting pod/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Aug 04 00:36:07.259826 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:07.259791    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz" podUID="44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Aug 04 00:36:08.259040 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:08.258991    2556 patch_prober.go:28] interesting pod/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Aug 04 00:36:08.259544 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:08.259078    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz" podUID="44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Aug 04 00:36:09.272330 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:09.272299    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:36:09.272836 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:09.272622    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:36:09.273445 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:09.273421    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:36:21.025973 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:21.025940    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1915a2d1-2mxqs"]
Aug 04 00:36:21.028482 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:21.028465    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1915a2d1-2mxqs"
Aug 04 00:36:21.030788 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:21.030767    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8db7m\""
Aug 04 00:36:21.037046 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:21.037021    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1915a2d1-2mxqs"]
Aug 04 00:36:21.066970 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:21.066936    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db02fea5-4d2e-4e8e-a4b2-afdf73053b26-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1915a2d1-2mxqs\" (UID: \"db02fea5-4d2e-4e8e-a4b2-afdf73053b26\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1915a2d1-2mxqs"
Aug 04 00:36:21.168157 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:21.168114    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db02fea5-4d2e-4e8e-a4b2-afdf73053b26-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1915a2d1-2mxqs\" (UID: \"db02fea5-4d2e-4e8e-a4b2-afdf73053b26\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1915a2d1-2mxqs"
Aug 04 00:36:21.168803 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:21.168782    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db02fea5-4d2e-4e8e-a4b2-afdf73053b26-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1915a2d1-2mxqs\" (UID: \"db02fea5-4d2e-4e8e-a4b2-afdf73053b26\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1915a2d1-2mxqs"
Aug 04 00:36:21.340331 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:21.340227    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1915a2d1-2mxqs"
Aug 04 00:36:21.473610 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:21.473565    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1915a2d1-2mxqs"]
Aug 04 00:36:21.477590 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:36:21.477550    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb02fea5_4d2e_4e8e_a4b2_afdf73053b26.slice/crio-a5ce3b5cdf1470eab8e49372fbe875e74b78085c6408fdad5002ebca123a2348 WatchSource:0}: Error finding container a5ce3b5cdf1470eab8e49372fbe875e74b78085c6408fdad5002ebca123a2348: Status 404 returned error can't find the container with id a5ce3b5cdf1470eab8e49372fbe875e74b78085c6408fdad5002ebca123a2348
Aug 04 00:36:22.210509 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:22.210474    2556 generic.go:356] "Generic (PLEG): container finished" podID="db02fea5-4d2e-4e8e-a4b2-afdf73053b26" containerID="a542c5fafa036d972266863baa0aa5528bd885c84488f2d37e9efa1c64413479" exitCode=0
Aug 04 00:36:22.210882 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:22.210524    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1915a2d1-2mxqs" event={"ID":"db02fea5-4d2e-4e8e-a4b2-afdf73053b26","Type":"ContainerDied","Data":"a542c5fafa036d972266863baa0aa5528bd885c84488f2d37e9efa1c64413479"}
Aug 04 00:36:22.210882 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:22.210578    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1915a2d1-2mxqs" event={"ID":"db02fea5-4d2e-4e8e-a4b2-afdf73053b26","Type":"ContainerStarted","Data":"a5ce3b5cdf1470eab8e49372fbe875e74b78085c6408fdad5002ebca123a2348"}
Aug 04 00:36:23.352941 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:23.352916    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1915a2d1-2mxqs"
Aug 04 00:36:23.493528 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:23.493428    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db02fea5-4d2e-4e8e-a4b2-afdf73053b26-maas-api-service-ca\") pod \"db02fea5-4d2e-4e8e-a4b2-afdf73053b26\" (UID: \"db02fea5-4d2e-4e8e-a4b2-afdf73053b26\") "
Aug 04 00:36:23.493860 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:23.493817    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db02fea5-4d2e-4e8e-a4b2-afdf73053b26-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "db02fea5-4d2e-4e8e-a4b2-afdf73053b26" (UID: "db02fea5-4d2e-4e8e-a4b2-afdf73053b26"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:36:23.594420 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:23.594378    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db02fea5-4d2e-4e8e-a4b2-afdf73053b26-maas-api-service-ca\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:36:24.223324 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:24.223286    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1915a2d1-2mxqs" event={"ID":"db02fea5-4d2e-4e8e-a4b2-afdf73053b26","Type":"ContainerDied","Data":"a5ce3b5cdf1470eab8e49372fbe875e74b78085c6408fdad5002ebca123a2348"}
Aug 04 00:36:24.223324 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:24.223307    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1915a2d1-2mxqs"
Aug 04 00:36:24.223540 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:24.223338    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5ce3b5cdf1470eab8e49372fbe875e74b78085c6408fdad5002ebca123a2348"
Aug 04 00:36:31.707446 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:31.707405    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1915a2d1-2mxqs"]
Aug 04 00:36:31.710867 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:31.710844    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1915a2d1-2mxqs"]
Aug 04 00:36:32.307941 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:32.307910    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db02fea5-4d2e-4e8e-a4b2-afdf73053b26" path="/var/lib/kubelet/pods/db02fea5-4d2e-4e8e-a4b2-afdf73053b26/volumes"
Aug 04 00:36:38.114166 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:38.114122    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"]
Aug 04 00:36:38.114784 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:38.114394    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz" podUID="44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" containerName="istio-proxy" containerID="cri-o://084d16393b2601f8f5df255695a682e1a20fbcf7f4e3313fff41a47cc1996331" gracePeriod=30
Aug 04 00:36:39.275213 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:39.275175    2556 patch_prober.go:28] interesting pod/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 00:36:39.275608 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:39.275233    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz" podUID="44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 00:36:43.327408 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.327374    2556 generic.go:356] "Generic (PLEG): container finished" podID="44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" containerID="084d16393b2601f8f5df255695a682e1a20fbcf7f4e3313fff41a47cc1996331" exitCode=0
Aug 04 00:36:43.327995 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.327447    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz" event={"ID":"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74","Type":"ContainerDied","Data":"084d16393b2601f8f5df255695a682e1a20fbcf7f4e3313fff41a47cc1996331"}
Aug 04 00:36:43.327995 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.327513    2556 scope.go:117] "RemoveContainer" containerID="f29f546982658af5a8d9935dfdda99b059c4fa485caeb8edc8e59ed28d864b1e"
Aug 04 00:36:43.374012 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.373984    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:36:43.486310 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.486215    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istio-token\") pod \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") "
Aug 04 00:36:43.486310 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.486268    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mq74r\" (UniqueName: \"kubernetes.io/projected/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-kube-api-access-mq74r\") pod \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") "
Aug 04 00:36:43.486310 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.486307    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-workload-socket\") pod \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") "
Aug 04 00:36:43.486602 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.486366    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-workload-certs\") pod \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") "
Aug 04 00:36:43.486602 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.486427    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istio-data\") pod \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") "
Aug 04 00:36:43.486602 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.486456    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istio-podinfo\") pod \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") "
Aug 04 00:36:43.486602 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.486513    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istiod-ca-cert\") pod \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") "
Aug 04 00:36:43.486602 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.486546    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istio-envoy\") pod \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") "
Aug 04 00:36:43.486602 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.486581    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-credential-socket\") pod \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\" (UID: \"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74\") "
Aug 04 00:36:43.486920 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.486671    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" (UID: "44dbfbc0-de7e-4d9a-a505-ad3d1c524a74"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:36:43.486920 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.486688    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" (UID: "44dbfbc0-de7e-4d9a-a505-ad3d1c524a74"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:36:43.486920 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.486908    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istio-data" (OuterVolumeSpecName: "istio-data") pod "44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" (UID: "44dbfbc0-de7e-4d9a-a505-ad3d1c524a74"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:36:43.487126 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.487089    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" (UID: "44dbfbc0-de7e-4d9a-a505-ad3d1c524a74"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:36:43.487126 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.487105    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" (UID: "44dbfbc0-de7e-4d9a-a505-ad3d1c524a74"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:36:43.487235 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.487221    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-workload-socket\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:36:43.487285 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.487243    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-workload-certs\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:36:43.487285 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.487258    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istio-data\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:36:43.488525 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.488494    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-kube-api-access-mq74r" (OuterVolumeSpecName: "kube-api-access-mq74r") pod "44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" (UID: "44dbfbc0-de7e-4d9a-a505-ad3d1c524a74"). InnerVolumeSpecName "kube-api-access-mq74r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:36:43.488525 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.488517    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istio-token" (OuterVolumeSpecName: "istio-token") pod "44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" (UID: "44dbfbc0-de7e-4d9a-a505-ad3d1c524a74"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:36:43.489062 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.489033    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" (UID: "44dbfbc0-de7e-4d9a-a505-ad3d1c524a74"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 00:36:43.489062 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.489038    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" (UID: "44dbfbc0-de7e-4d9a-a505-ad3d1c524a74"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:36:43.588591 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.588554    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istio-token\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:36:43.588591 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.588585    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mq74r\" (UniqueName: \"kubernetes.io/projected/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-kube-api-access-mq74r\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:36:43.588591 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.588596    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istio-podinfo\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:36:43.588591 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.588604    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istiod-ca-cert\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:36:43.588888 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.588612    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-istio-envoy\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:36:43.588888 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:43.588619    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74-credential-socket\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:36:44.334172 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:44.334139    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz" event={"ID":"44dbfbc0-de7e-4d9a-a505-ad3d1c524a74","Type":"ContainerDied","Data":"152965415df18b4aef9abe5555554ecbdc3674420fbc96971a31fec6c4a3ea11"}
Aug 04 00:36:44.334547 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:44.334201    2556 scope.go:117] "RemoveContainer" containerID="084d16393b2601f8f5df255695a682e1a20fbcf7f4e3313fff41a47cc1996331"
Aug 04 00:36:44.334547 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:44.334149    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"
Aug 04 00:36:44.351049 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:44.351027    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"]
Aug 04 00:36:44.354813 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:44.354792    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-1915a2d1-openshift-default-f7c6cbbb4-ft9qz"]
Aug 04 00:36:46.307522 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:36:46.307486    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" path="/var/lib/kubelet/pods/44dbfbc0-de7e-4d9a-a505-ad3d1c524a74/volumes"
Aug 04 00:37:26.383481 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:37:26.383449    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:37:26.388851 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:37:26.388830    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:38:26.473287 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:26.473211    2556 scope.go:117] "RemoveContainer" containerID="61cf95c5672b07410a51b41b027d4ee7c372a500d812a9d4164d97e3f7982a4a"
Aug 04 00:38:53.856980 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:53.856938    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"]
Aug 04 00:38:53.857569 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:53.857549    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" containerName="istio-proxy"
Aug 04 00:38:53.857656 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:53.857573    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" containerName="istio-proxy"
Aug 04 00:38:53.857656 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:53.857588    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db02fea5-4d2e-4e8e-a4b2-afdf73053b26" containerName="revoke-keys"
Aug 04 00:38:53.857656 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:53.857596    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="db02fea5-4d2e-4e8e-a4b2-afdf73053b26" containerName="revoke-keys"
Aug 04 00:38:53.857656 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:53.857615    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" containerName="istio-proxy"
Aug 04 00:38:53.857656 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:53.857624    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" containerName="istio-proxy"
Aug 04 00:38:53.857925 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:53.857739    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" containerName="istio-proxy"
Aug 04 00:38:53.857925 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:53.857759    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="44dbfbc0-de7e-4d9a-a505-ad3d1c524a74" containerName="istio-proxy"
Aug 04 00:38:53.857925 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:53.857769    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="db02fea5-4d2e-4e8e-a4b2-afdf73053b26" containerName="revoke-keys"
Aug 04 00:38:53.861066 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:53.861042    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:53.863859 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:53.863837    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f4ab9294-openshift-default-dockercfg-kkwt5\""
Aug 04 00:38:53.874551 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:53.874527    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"]
Aug 04 00:38:53.920953 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:53.920910    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlbb9\" (UniqueName: \"kubernetes.io/projected/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-kube-api-access-zlbb9\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:53.920953 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:53.920956    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istio-envoy\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:53.921173 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:53.920987    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istio-data\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:53.921173 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:53.921054    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istiod-ca-cert\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:53.921173 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:53.921105    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-workload-socket\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:53.921173 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:53.921129    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-credential-socket\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:53.921173 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:53.921149    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istio-podinfo\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:53.921336 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:53.921181    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istio-token\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:53.921336 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:53.921227    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-workload-certs\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:54.022506 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:54.022465    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istio-token\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:54.022689 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:54.022524    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-workload-certs\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:54.022689 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:54.022574    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlbb9\" (UniqueName: \"kubernetes.io/projected/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-kube-api-access-zlbb9\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:54.022689 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:54.022608    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istio-envoy\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:54.022689 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:54.022653    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istio-data\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:54.022689 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:54.022688    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istiod-ca-cert\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:54.023037 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:54.022744    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-workload-socket\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:54.023037 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:54.022772    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-credential-socket\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:54.023037 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:54.022897    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istio-podinfo\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:54.023205 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:54.023135    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-workload-socket\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:54.023265 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:54.023215    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istio-data\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:54.023324 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:54.023258    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-credential-socket\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:54.023380 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:54.023344    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-workload-certs\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:54.023514 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:54.023493    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istiod-ca-cert\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:54.025096 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:54.025063    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istio-envoy\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:54.025333 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:54.025315    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istio-podinfo\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:54.030406 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:54.030367    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istio-token\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:54.030532 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:54.030514    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlbb9\" (UniqueName: \"kubernetes.io/projected/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-kube-api-access-zlbb9\") pod \"e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") " pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:54.171484 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:54.171376    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:54.313336 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:54.313175    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"]
Aug 04 00:38:54.315676 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:38:54.315641    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbafb7ad9_ce89_4f47_93b4_7c9e39537f5d.slice/crio-6d351f910ac321852dc9d51367ad381569b46b34a3e5a5edd35e9b457b8f9761 WatchSource:0}: Error finding container 6d351f910ac321852dc9d51367ad381569b46b34a3e5a5edd35e9b457b8f9761: Status 404 returned error can't find the container with id 6d351f910ac321852dc9d51367ad381569b46b34a3e5a5edd35e9b457b8f9761
Aug 04 00:38:54.318212 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:54.318176    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:38:54.318324 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:54.318251    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:38:54.318324 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:54.318289    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:38:55.013567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:55.013530    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4" event={"ID":"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d","Type":"ContainerStarted","Data":"551bce0b8fcd4d5ba7e6dc92c1b9fe8e925b8d2301d53be8a6172e288afeb3e0"}
Aug 04 00:38:55.014007 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:55.013582    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4" event={"ID":"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d","Type":"ContainerStarted","Data":"6d351f910ac321852dc9d51367ad381569b46b34a3e5a5edd35e9b457b8f9761"}
Aug 04 00:38:55.033883 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:55.033834    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4" podStartSLOduration=2.03381852 podStartE2EDuration="2.03381852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:38:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:38:55.03287961 +0000 UTC m=+2189.201516981" watchObservedRunningTime="2026-08-04 00:38:55.03381852 +0000 UTC m=+2189.202455889"
Aug 04 00:38:55.172242 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:55.172198    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:55.177138 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:55.177107    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:56.020255 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:56.020226    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:38:56.021229 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:38:56.021210    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:39:11.022209 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:11.022173    2556 patch_prober.go:28] interesting pod/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Aug 04 00:39:11.022661 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:11.022232    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4" podUID="bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Aug 04 00:39:11.110975 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:11.110941    2556 generic.go:356] "Generic (PLEG): container finished" podID="bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" containerID="551bce0b8fcd4d5ba7e6dc92c1b9fe8e925b8d2301d53be8a6172e288afeb3e0" exitCode=0
Aug 04 00:39:11.111151 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:11.111018    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4" event={"ID":"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d","Type":"ContainerDied","Data":"551bce0b8fcd4d5ba7e6dc92c1b9fe8e925b8d2301d53be8a6172e288afeb3e0"}
Aug 04 00:39:11.111415 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:11.111400    2556 scope.go:117] "RemoveContainer" containerID="551bce0b8fcd4d5ba7e6dc92c1b9fe8e925b8d2301d53be8a6172e288afeb3e0"
Aug 04 00:39:11.112547 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:11.112518    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:39:11.112604 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:11.112589    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:39:11.112640 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:11.112627    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:39:12.118498 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:12.118461    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4" event={"ID":"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d","Type":"ContainerStarted","Data":"c934bbdd1e1c91a1d871c0aa0c4e67fe5014a674913be834ad9920c090175d9b"}
Aug 04 00:39:12.171633 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:12.171585    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:39:12.171934 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:12.171908    2556 patch_prober.go:28] interesting pod/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Aug 04 00:39:12.172035 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:12.171967    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4" podUID="bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Aug 04 00:39:13.172633 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:13.172594    2556 patch_prober.go:28] interesting pod/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Aug 04 00:39:13.173164 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:13.172662    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4" podUID="bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Aug 04 00:39:14.171839 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:14.171797    2556 patch_prober.go:28] interesting pod/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Aug 04 00:39:14.172035 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:14.171857    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4" podUID="bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Aug 04 00:39:15.172320 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:15.172276    2556 patch_prober.go:28] interesting pod/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Aug 04 00:39:15.172761 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:15.172342    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4" podUID="bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Aug 04 00:39:16.172878 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:16.172833    2556 patch_prober.go:28] interesting pod/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Aug 04 00:39:16.173430 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:16.172896    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4" podUID="bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Aug 04 00:39:17.177942 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:17.177892    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:39:17.178607 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:17.178579    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:39:17.179595 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:17.179575    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:39:26.492909 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:26.492876    2556 scope.go:117] "RemoveContainer" containerID="fc569745ff3a1fe79293564f0f4e0af6a8828fdd28d2b0997d0e895641692c87"
Aug 04 00:39:26.501619 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:26.501596    2556 scope.go:117] "RemoveContainer" containerID="938a38d90bac0aecf5227b2d901cf0b3cc1878ab172c17a39e677a2c3e4a926a"
Aug 04 00:39:30.202985 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.202944    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"]
Aug 04 00:39:30.207657 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.207634    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:39:30.211118 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.211089    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f4ab9294\"/\"default-dockercfg-sj6ml\""
Aug 04 00:39:30.211252 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.211141    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f4ab9294\"/\"kube-root-ca.crt\""
Aug 04 00:39:30.211252 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.211165    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f4ab9294\"/\"openshift-service-ca.crt\""
Aug 04 00:39:30.211252 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.211089    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f4ab9294\"/\"e2e-lifecycle-model-f4ab9294-kserve-self-signed-certs\""
Aug 04 00:39:30.216255 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.216196    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"]
Aug 04 00:39:30.287313 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.287272    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7485e38e-0887-4f2d-ac02-b3efcad9d992-home\") pod \"e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8\" (UID: \"7485e38e-0887-4f2d-ac02-b3efcad9d992\") " pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:39:30.287525 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.287359    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7485e38e-0887-4f2d-ac02-b3efcad9d992-model-cache\") pod \"e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8\" (UID: \"7485e38e-0887-4f2d-ac02-b3efcad9d992\") " pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:39:30.287525 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.287410    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7485e38e-0887-4f2d-ac02-b3efcad9d992-tls-certs\") pod \"e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8\" (UID: \"7485e38e-0887-4f2d-ac02-b3efcad9d992\") " pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:39:30.287525 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.287467    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7485e38e-0887-4f2d-ac02-b3efcad9d992-tmp-dir\") pod \"e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8\" (UID: \"7485e38e-0887-4f2d-ac02-b3efcad9d992\") " pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:39:30.287688 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.287549    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l29fz\" (UniqueName: \"kubernetes.io/projected/7485e38e-0887-4f2d-ac02-b3efcad9d992-kube-api-access-l29fz\") pod \"e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8\" (UID: \"7485e38e-0887-4f2d-ac02-b3efcad9d992\") " pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:39:30.287688 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.287583    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7485e38e-0887-4f2d-ac02-b3efcad9d992-dshm\") pod \"e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8\" (UID: \"7485e38e-0887-4f2d-ac02-b3efcad9d992\") " pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:39:30.388619 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.388580    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7485e38e-0887-4f2d-ac02-b3efcad9d992-home\") pod \"e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8\" (UID: \"7485e38e-0887-4f2d-ac02-b3efcad9d992\") " pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:39:30.388865 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.388673    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7485e38e-0887-4f2d-ac02-b3efcad9d992-model-cache\") pod \"e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8\" (UID: \"7485e38e-0887-4f2d-ac02-b3efcad9d992\") " pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:39:30.388865 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.388765    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7485e38e-0887-4f2d-ac02-b3efcad9d992-tls-certs\") pod \"e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8\" (UID: \"7485e38e-0887-4f2d-ac02-b3efcad9d992\") " pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:39:30.388865 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.388801    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7485e38e-0887-4f2d-ac02-b3efcad9d992-tmp-dir\") pod \"e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8\" (UID: \"7485e38e-0887-4f2d-ac02-b3efcad9d992\") " pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:39:30.388865 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.388841    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l29fz\" (UniqueName: \"kubernetes.io/projected/7485e38e-0887-4f2d-ac02-b3efcad9d992-kube-api-access-l29fz\") pod \"e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8\" (UID: \"7485e38e-0887-4f2d-ac02-b3efcad9d992\") " pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:39:30.388865 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.388864    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7485e38e-0887-4f2d-ac02-b3efcad9d992-dshm\") pod \"e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8\" (UID: \"7485e38e-0887-4f2d-ac02-b3efcad9d992\") " pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:39:30.389152 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.389028    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7485e38e-0887-4f2d-ac02-b3efcad9d992-home\") pod \"e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8\" (UID: \"7485e38e-0887-4f2d-ac02-b3efcad9d992\") " pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:39:30.389152 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.389141    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7485e38e-0887-4f2d-ac02-b3efcad9d992-model-cache\") pod \"e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8\" (UID: \"7485e38e-0887-4f2d-ac02-b3efcad9d992\") " pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:39:30.389274 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.389170    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7485e38e-0887-4f2d-ac02-b3efcad9d992-tmp-dir\") pod \"e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8\" (UID: \"7485e38e-0887-4f2d-ac02-b3efcad9d992\") " pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:39:30.391119 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.391097    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7485e38e-0887-4f2d-ac02-b3efcad9d992-dshm\") pod \"e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8\" (UID: \"7485e38e-0887-4f2d-ac02-b3efcad9d992\") " pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:39:30.391387 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.391367    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7485e38e-0887-4f2d-ac02-b3efcad9d992-tls-certs\") pod \"e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8\" (UID: \"7485e38e-0887-4f2d-ac02-b3efcad9d992\") " pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:39:30.397326 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.397299    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l29fz\" (UniqueName: \"kubernetes.io/projected/7485e38e-0887-4f2d-ac02-b3efcad9d992-kube-api-access-l29fz\") pod \"e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8\" (UID: \"7485e38e-0887-4f2d-ac02-b3efcad9d992\") " pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:39:30.520284 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.520247    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:39:30.665296 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:30.665268    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"]
Aug 04 00:39:30.667514 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:39:30.667485    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7485e38e_0887_4f2d_ac02_b3efcad9d992.slice/crio-b0fffab958009368dc0ecd7ae982dfa155f0263b7f447b9b59b56fd2688b17b7 WatchSource:0}: Error finding container b0fffab958009368dc0ecd7ae982dfa155f0263b7f447b9b59b56fd2688b17b7: Status 404 returned error can't find the container with id b0fffab958009368dc0ecd7ae982dfa155f0263b7f447b9b59b56fd2688b17b7
Aug 04 00:39:31.222178 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:31.222129    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8" event={"ID":"7485e38e-0887-4f2d-ac02-b3efcad9d992","Type":"ContainerStarted","Data":"c14d1e152a61a92f04e0899c7e67e30a44a6325656e91ecb9fb311985110e431"}
Aug 04 00:39:31.222178 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:31.222180    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8" event={"ID":"7485e38e-0887-4f2d-ac02-b3efcad9d992","Type":"ContainerStarted","Data":"b0fffab958009368dc0ecd7ae982dfa155f0263b7f447b9b59b56fd2688b17b7"}
Aug 04 00:39:31.247110 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:31.247040    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8" podStartSLOduration=1.247017356 podStartE2EDuration="1.247017356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:39:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:39:31.244932057 +0000 UTC m=+2225.413569429" watchObservedRunningTime="2026-08-04 00:39:31.247017356 +0000 UTC m=+2225.415654729"
Aug 04 00:39:40.521064 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:40.521018    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:39:40.521560 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:40.521164    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:39:40.533965 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:40.533933    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:39:41.285818 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:39:41.285786    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:40:19.873984 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:19.873938    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"]
Aug 04 00:40:26.526767 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:26.526731    2556 scope.go:117] "RemoveContainer" containerID="58c8dc78423fe15084d984fadd2cd57db4abe8804590f5669981f55994c4ad59"
Aug 04 00:40:34.894654 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:34.894607    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8" podUID="7485e38e-0887-4f2d-ac02-b3efcad9d992" containerName="main" containerID="cri-o://c14d1e152a61a92f04e0899c7e67e30a44a6325656e91ecb9fb311985110e431" gracePeriod=45
Aug 04 00:40:35.146195 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.146122    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:40:35.247836 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.247798    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7485e38e-0887-4f2d-ac02-b3efcad9d992-tls-certs\") pod \"7485e38e-0887-4f2d-ac02-b3efcad9d992\" (UID: \"7485e38e-0887-4f2d-ac02-b3efcad9d992\") "
Aug 04 00:40:35.248039 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.247857    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7485e38e-0887-4f2d-ac02-b3efcad9d992-tmp-dir\") pod \"7485e38e-0887-4f2d-ac02-b3efcad9d992\" (UID: \"7485e38e-0887-4f2d-ac02-b3efcad9d992\") "
Aug 04 00:40:35.248039 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.247876    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7485e38e-0887-4f2d-ac02-b3efcad9d992-model-cache\") pod \"7485e38e-0887-4f2d-ac02-b3efcad9d992\" (UID: \"7485e38e-0887-4f2d-ac02-b3efcad9d992\") "
Aug 04 00:40:35.248039 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.247895    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7485e38e-0887-4f2d-ac02-b3efcad9d992-home\") pod \"7485e38e-0887-4f2d-ac02-b3efcad9d992\" (UID: \"7485e38e-0887-4f2d-ac02-b3efcad9d992\") "
Aug 04 00:40:35.248039 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.247910    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7485e38e-0887-4f2d-ac02-b3efcad9d992-dshm\") pod \"7485e38e-0887-4f2d-ac02-b3efcad9d992\" (UID: \"7485e38e-0887-4f2d-ac02-b3efcad9d992\") "
Aug 04 00:40:35.248039 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.247960    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l29fz\" (UniqueName: \"kubernetes.io/projected/7485e38e-0887-4f2d-ac02-b3efcad9d992-kube-api-access-l29fz\") pod \"7485e38e-0887-4f2d-ac02-b3efcad9d992\" (UID: \"7485e38e-0887-4f2d-ac02-b3efcad9d992\") "
Aug 04 00:40:35.248363 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.248209    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7485e38e-0887-4f2d-ac02-b3efcad9d992-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7485e38e-0887-4f2d-ac02-b3efcad9d992" (UID: "7485e38e-0887-4f2d-ac02-b3efcad9d992"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:40:35.248363 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.248216    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7485e38e-0887-4f2d-ac02-b3efcad9d992-home" (OuterVolumeSpecName: "home") pod "7485e38e-0887-4f2d-ac02-b3efcad9d992" (UID: "7485e38e-0887-4f2d-ac02-b3efcad9d992"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:40:35.248363 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.248229    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7485e38e-0887-4f2d-ac02-b3efcad9d992-model-cache" (OuterVolumeSpecName: "model-cache") pod "7485e38e-0887-4f2d-ac02-b3efcad9d992" (UID: "7485e38e-0887-4f2d-ac02-b3efcad9d992"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:40:35.248469 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.248415    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7485e38e-0887-4f2d-ac02-b3efcad9d992-tmp-dir\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:40:35.248469 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.248438    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7485e38e-0887-4f2d-ac02-b3efcad9d992-model-cache\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:40:35.248469 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.248453    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7485e38e-0887-4f2d-ac02-b3efcad9d992-home\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:40:35.250130 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.250106    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7485e38e-0887-4f2d-ac02-b3efcad9d992-dshm" (OuterVolumeSpecName: "dshm") pod "7485e38e-0887-4f2d-ac02-b3efcad9d992" (UID: "7485e38e-0887-4f2d-ac02-b3efcad9d992"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:40:35.250210 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.250163    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7485e38e-0887-4f2d-ac02-b3efcad9d992-kube-api-access-l29fz" (OuterVolumeSpecName: "kube-api-access-l29fz") pod "7485e38e-0887-4f2d-ac02-b3efcad9d992" (UID: "7485e38e-0887-4f2d-ac02-b3efcad9d992"). InnerVolumeSpecName "kube-api-access-l29fz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:40:35.250262 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.250242    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7485e38e-0887-4f2d-ac02-b3efcad9d992-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7485e38e-0887-4f2d-ac02-b3efcad9d992" (UID: "7485e38e-0887-4f2d-ac02-b3efcad9d992"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:40:35.349799 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.349757    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7485e38e-0887-4f2d-ac02-b3efcad9d992-dshm\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:40:35.349799 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.349789    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l29fz\" (UniqueName: \"kubernetes.io/projected/7485e38e-0887-4f2d-ac02-b3efcad9d992-kube-api-access-l29fz\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:40:35.349799 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.349800    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7485e38e-0887-4f2d-ac02-b3efcad9d992-tls-certs\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:40:35.553365 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.553333    2556 generic.go:356] "Generic (PLEG): container finished" podID="7485e38e-0887-4f2d-ac02-b3efcad9d992" containerID="c14d1e152a61a92f04e0899c7e67e30a44a6325656e91ecb9fb311985110e431" exitCode=0
Aug 04 00:40:35.553529 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.553375    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8" event={"ID":"7485e38e-0887-4f2d-ac02-b3efcad9d992","Type":"ContainerDied","Data":"c14d1e152a61a92f04e0899c7e67e30a44a6325656e91ecb9fb311985110e431"}
Aug 04 00:40:35.553529 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.553386    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"
Aug 04 00:40:35.553529 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.553406    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8" event={"ID":"7485e38e-0887-4f2d-ac02-b3efcad9d992","Type":"ContainerDied","Data":"b0fffab958009368dc0ecd7ae982dfa155f0263b7f447b9b59b56fd2688b17b7"}
Aug 04 00:40:35.553529 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.553426    2556 scope.go:117] "RemoveContainer" containerID="c14d1e152a61a92f04e0899c7e67e30a44a6325656e91ecb9fb311985110e431"
Aug 04 00:40:35.563481 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.563457    2556 scope.go:117] "RemoveContainer" containerID="c14d1e152a61a92f04e0899c7e67e30a44a6325656e91ecb9fb311985110e431"
Aug 04 00:40:35.563865 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:40:35.563839    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c14d1e152a61a92f04e0899c7e67e30a44a6325656e91ecb9fb311985110e431\": container with ID starting with c14d1e152a61a92f04e0899c7e67e30a44a6325656e91ecb9fb311985110e431 not found: ID does not exist" containerID="c14d1e152a61a92f04e0899c7e67e30a44a6325656e91ecb9fb311985110e431"
Aug 04 00:40:35.563971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.563879    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c14d1e152a61a92f04e0899c7e67e30a44a6325656e91ecb9fb311985110e431"} err="failed to get container status \"c14d1e152a61a92f04e0899c7e67e30a44a6325656e91ecb9fb311985110e431\": rpc error: code = NotFound desc = could not find container \"c14d1e152a61a92f04e0899c7e67e30a44a6325656e91ecb9fb311985110e431\": container with ID starting with c14d1e152a61a92f04e0899c7e67e30a44a6325656e91ecb9fb311985110e431 not found: ID does not exist"
Aug 04 00:40:35.574939 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.574911    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"]
Aug 04 00:40:35.578497 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:35.578471    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-f4ab9294/e2e-lifecycle-model-f4ab9294-kserve-6fb67f4d6c-5mzv8"]
Aug 04 00:40:36.308076 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:40:36.308034    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7485e38e-0887-4f2d-ac02-b3efcad9d992" path="/var/lib/kubelet/pods/7485e38e-0887-4f2d-ac02-b3efcad9d992/volumes"
Aug 04 00:41:02.779064 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:02.779016    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"]
Aug 04 00:41:02.779579 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:02.779295    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4" podUID="bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" containerName="istio-proxy" containerID="cri-o://c934bbdd1e1c91a1d871c0aa0c4e67fe5014a674913be834ad9920c090175d9b" gracePeriod=30
Aug 04 00:41:08.044230 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.044163    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:41:08.174077 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.174033    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-workload-socket\") pod \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") "
Aug 04 00:41:08.174077 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.174079    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-workload-certs\") pod \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") "
Aug 04 00:41:08.174326 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.174140    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istio-envoy\") pod \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") "
Aug 04 00:41:08.174326 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.174182    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istio-token\") pod \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") "
Aug 04 00:41:08.174326 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.174231    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-credential-socket\") pod \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") "
Aug 04 00:41:08.174326 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.174284    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istio-data\") pod \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") "
Aug 04 00:41:08.174557 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.174353    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istio-podinfo\") pod \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") "
Aug 04 00:41:08.174557 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.174366    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" (UID: "bafb7ad9-ce89-4f47-93b4-7c9e39537f5d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:41:08.174557 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.174381    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istiod-ca-cert\") pod \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") "
Aug 04 00:41:08.174557 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.174417    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlbb9\" (UniqueName: \"kubernetes.io/projected/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-kube-api-access-zlbb9\") pod \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\" (UID: \"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d\") "
Aug 04 00:41:08.174557 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.174462    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" (UID: "bafb7ad9-ce89-4f47-93b4-7c9e39537f5d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:41:08.174860 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.174637    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" (UID: "bafb7ad9-ce89-4f47-93b4-7c9e39537f5d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:41:08.174860 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.174625    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istio-data" (OuterVolumeSpecName: "istio-data") pod "bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" (UID: "bafb7ad9-ce89-4f47-93b4-7c9e39537f5d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:41:08.174860 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.174708    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-workload-socket\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:41:08.174860 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.174759    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-workload-certs\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:41:08.174860 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.174773    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-credential-socket\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:41:08.174860 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.174776    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" (UID: "bafb7ad9-ce89-4f47-93b4-7c9e39537f5d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:41:08.176476 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.176452    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" (UID: "bafb7ad9-ce89-4f47-93b4-7c9e39537f5d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 00:41:08.176572 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.176556    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-kube-api-access-zlbb9" (OuterVolumeSpecName: "kube-api-access-zlbb9") pod "bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" (UID: "bafb7ad9-ce89-4f47-93b4-7c9e39537f5d"). InnerVolumeSpecName "kube-api-access-zlbb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:41:08.176853 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.176830    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istio-token" (OuterVolumeSpecName: "istio-token") pod "bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" (UID: "bafb7ad9-ce89-4f47-93b4-7c9e39537f5d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:41:08.176927 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.176828    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" (UID: "bafb7ad9-ce89-4f47-93b4-7c9e39537f5d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:41:08.275498 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.275455    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istio-podinfo\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:41:08.275498 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.275489    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istiod-ca-cert\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:41:08.275498 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.275498    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlbb9\" (UniqueName: \"kubernetes.io/projected/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-kube-api-access-zlbb9\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:41:08.275498 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.275508    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istio-envoy\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:41:08.275820 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.275517    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istio-token\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:41:08.275820 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.275525    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d-istio-data\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:41:08.721881 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.721776    2556 generic.go:356] "Generic (PLEG): container finished" podID="bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" containerID="c934bbdd1e1c91a1d871c0aa0c4e67fe5014a674913be834ad9920c090175d9b" exitCode=0
Aug 04 00:41:08.721881 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.721823    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"
Aug 04 00:41:08.721881 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.721867    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4" event={"ID":"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d","Type":"ContainerDied","Data":"c934bbdd1e1c91a1d871c0aa0c4e67fe5014a674913be834ad9920c090175d9b"}
Aug 04 00:41:08.722135 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.721922    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4" event={"ID":"bafb7ad9-ce89-4f47-93b4-7c9e39537f5d","Type":"ContainerDied","Data":"6d351f910ac321852dc9d51367ad381569b46b34a3e5a5edd35e9b457b8f9761"}
Aug 04 00:41:08.722135 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.721946    2556 scope.go:117] "RemoveContainer" containerID="c934bbdd1e1c91a1d871c0aa0c4e67fe5014a674913be834ad9920c090175d9b"
Aug 04 00:41:08.732675 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.732651    2556 scope.go:117] "RemoveContainer" containerID="551bce0b8fcd4d5ba7e6dc92c1b9fe8e925b8d2301d53be8a6172e288afeb3e0"
Aug 04 00:41:08.741953 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.741917    2556 scope.go:117] "RemoveContainer" containerID="c934bbdd1e1c91a1d871c0aa0c4e67fe5014a674913be834ad9920c090175d9b"
Aug 04 00:41:08.742305 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:41:08.742283    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c934bbdd1e1c91a1d871c0aa0c4e67fe5014a674913be834ad9920c090175d9b\": container with ID starting with c934bbdd1e1c91a1d871c0aa0c4e67fe5014a674913be834ad9920c090175d9b not found: ID does not exist" containerID="c934bbdd1e1c91a1d871c0aa0c4e67fe5014a674913be834ad9920c090175d9b"
Aug 04 00:41:08.742381 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.742314    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c934bbdd1e1c91a1d871c0aa0c4e67fe5014a674913be834ad9920c090175d9b"} err="failed to get container status \"c934bbdd1e1c91a1d871c0aa0c4e67fe5014a674913be834ad9920c090175d9b\": rpc error: code = NotFound desc = could not find container \"c934bbdd1e1c91a1d871c0aa0c4e67fe5014a674913be834ad9920c090175d9b\": container with ID starting with c934bbdd1e1c91a1d871c0aa0c4e67fe5014a674913be834ad9920c090175d9b not found: ID does not exist"
Aug 04 00:41:08.742381 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.742336    2556 scope.go:117] "RemoveContainer" containerID="551bce0b8fcd4d5ba7e6dc92c1b9fe8e925b8d2301d53be8a6172e288afeb3e0"
Aug 04 00:41:08.742617 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:41:08.742597    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"551bce0b8fcd4d5ba7e6dc92c1b9fe8e925b8d2301d53be8a6172e288afeb3e0\": container with ID starting with 551bce0b8fcd4d5ba7e6dc92c1b9fe8e925b8d2301d53be8a6172e288afeb3e0 not found: ID does not exist" containerID="551bce0b8fcd4d5ba7e6dc92c1b9fe8e925b8d2301d53be8a6172e288afeb3e0"
Aug 04 00:41:08.742677 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.742625    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"551bce0b8fcd4d5ba7e6dc92c1b9fe8e925b8d2301d53be8a6172e288afeb3e0"} err="failed to get container status \"551bce0b8fcd4d5ba7e6dc92c1b9fe8e925b8d2301d53be8a6172e288afeb3e0\": rpc error: code = NotFound desc = could not find container \"551bce0b8fcd4d5ba7e6dc92c1b9fe8e925b8d2301d53be8a6172e288afeb3e0\": container with ID starting with 551bce0b8fcd4d5ba7e6dc92c1b9fe8e925b8d2301d53be8a6172e288afeb3e0 not found: ID does not exist"
Aug 04 00:41:08.743063 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.743043    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"]
Aug 04 00:41:08.746150 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:08.746123    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f4ab9294-openshift-default-5788c8ff5b-22nk4"]
Aug 04 00:41:10.307796 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:41:10.307756    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" path="/var/lib/kubelet/pods/bafb7ad9-ce89-4f47-93b4-7c9e39537f5d/volumes"
Aug 04 00:42:07.170254 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.170217    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"]
Aug 04 00:42:07.170753 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.170617    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" containerName="istio-proxy"
Aug 04 00:42:07.170753 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.170630    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" containerName="istio-proxy"
Aug 04 00:42:07.170753 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.170644    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" containerName="istio-proxy"
Aug 04 00:42:07.170753 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.170650    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" containerName="istio-proxy"
Aug 04 00:42:07.170753 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.170665    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7485e38e-0887-4f2d-ac02-b3efcad9d992" containerName="main"
Aug 04 00:42:07.170753 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.170672    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7485e38e-0887-4f2d-ac02-b3efcad9d992" containerName="main"
Aug 04 00:42:07.170753 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.170753    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" containerName="istio-proxy"
Aug 04 00:42:07.170992 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.170763    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7485e38e-0887-4f2d-ac02-b3efcad9d992" containerName="main"
Aug 04 00:42:07.170992 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.170770    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bafb7ad9-ce89-4f47-93b4-7c9e39537f5d" containerName="istio-proxy"
Aug 04 00:42:07.173901 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.173883    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.176109 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.176087    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-964853-openshift-default-dockercfg-62c7z\""
Aug 04 00:42:07.184811 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.184784    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"]
Aug 04 00:42:07.245078 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.245022    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istiod-ca-cert\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.245289 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.245090    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istio-token\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.245289 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.245120    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-workload-certs\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.245289 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.245153    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlqpk\" (UniqueName: \"kubernetes.io/projected/ee5a83b6-a67c-4e9e-957a-80f7a654961d-kube-api-access-mlqpk\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.245289 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.245214    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-workload-socket\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.245289 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.245261    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-credential-socket\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.245289 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.245282    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istio-podinfo\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.245635 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.245313    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istio-envoy\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.245635 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.245371    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istio-data\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.345906 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.345868    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-workload-certs\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.345906 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.345918    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlqpk\" (UniqueName: \"kubernetes.io/projected/ee5a83b6-a67c-4e9e-957a-80f7a654961d-kube-api-access-mlqpk\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.346162 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.345940    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-workload-socket\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.346162 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.345973    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-credential-socket\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.346162 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.345991    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istio-podinfo\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.346162 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.346020    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istio-envoy\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.346378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.346176    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istio-data\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.346378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.346251    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istiod-ca-cert\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.346378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.346297    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istio-token\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.346378 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.346360    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-workload-certs\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.346609 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.346425    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-credential-socket\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.346609 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.346474    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-workload-socket\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.346757 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.346621    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istio-data\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.347130 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.347103    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istiod-ca-cert\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.348464 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.348437    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istio-envoy\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.348597 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.348539    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istio-podinfo\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.354319 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.354287    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istio-token\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.354464 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.354448    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlqpk\" (UniqueName: \"kubernetes.io/projected/ee5a83b6-a67c-4e9e-957a-80f7a654961d-kube-api-access-mlqpk\") pod \"e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") " pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.485463 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.485363    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:07.637584 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.637554    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"]
Aug 04 00:42:07.640306 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:42:07.640276    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee5a83b6_a67c_4e9e_957a_80f7a654961d.slice/crio-61edf7bbf1e4177bde03e489a82fdc4e283c1a28c368baed8402c77a345c6dd3 WatchSource:0}: Error finding container 61edf7bbf1e4177bde03e489a82fdc4e283c1a28c368baed8402c77a345c6dd3: Status 404 returned error can't find the container with id 61edf7bbf1e4177bde03e489a82fdc4e283c1a28c368baed8402c77a345c6dd3
Aug 04 00:42:07.642615 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.642575    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:42:07.642707 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.642669    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:42:07.642774 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:07.642710    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:42:08.025209 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:08.025173    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82" event={"ID":"ee5a83b6-a67c-4e9e-957a-80f7a654961d","Type":"ContainerStarted","Data":"ff035abe6169f54087bd303ccced2e7d25fbcc7ee67090ed1901e85daa4c1390"}
Aug 04 00:42:08.025398 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:08.025226    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82" event={"ID":"ee5a83b6-a67c-4e9e-957a-80f7a654961d","Type":"ContainerStarted","Data":"61edf7bbf1e4177bde03e489a82fdc4e283c1a28c368baed8402c77a345c6dd3"}
Aug 04 00:42:08.044856 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:08.044788    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82" podStartSLOduration=1.04476587 podStartE2EDuration="1.04476587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:42:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:42:08.043747811 +0000 UTC m=+2382.212385183" watchObservedRunningTime="2026-08-04 00:42:08.04476587 +0000 UTC m=+2382.213403243"
Aug 04 00:42:08.485996 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:08.485903    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:08.490842 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:08.490811    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:09.030643 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:09.030612    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:09.031702 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:09.031680    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:24.032495 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:24.032458    2556 patch_prober.go:28] interesting pod/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Aug 04 00:42:24.032949 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:24.032531    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82" podUID="ee5a83b6-a67c-4e9e-957a-80f7a654961d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Aug 04 00:42:24.121480 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:24.121445    2556 generic.go:356] "Generic (PLEG): container finished" podID="ee5a83b6-a67c-4e9e-957a-80f7a654961d" containerID="ff035abe6169f54087bd303ccced2e7d25fbcc7ee67090ed1901e85daa4c1390" exitCode=0
Aug 04 00:42:24.121663 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:24.121518    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82" event={"ID":"ee5a83b6-a67c-4e9e-957a-80f7a654961d","Type":"ContainerDied","Data":"ff035abe6169f54087bd303ccced2e7d25fbcc7ee67090ed1901e85daa4c1390"}
Aug 04 00:42:24.121956 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:24.121936    2556 scope.go:117] "RemoveContainer" containerID="ff035abe6169f54087bd303ccced2e7d25fbcc7ee67090ed1901e85daa4c1390"
Aug 04 00:42:24.123044 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:24.123015    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:42:24.123121 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:24.123100    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:42:24.123171 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:24.123152    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:42:25.129008 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:25.128964    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82" event={"ID":"ee5a83b6-a67c-4e9e-957a-80f7a654961d","Type":"ContainerStarted","Data":"0ad757a0f440071119675af594dc160f0c104aed68011cfdcf6863ab600203a7"}
Aug 04 00:42:25.485697 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:25.485602    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:25.485893 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:25.485866    2556 patch_prober.go:28] interesting pod/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Aug 04 00:42:25.485950 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:25.485934    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82" podUID="ee5a83b6-a67c-4e9e-957a-80f7a654961d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Aug 04 00:42:26.415584 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:26.415556    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:42:26.422747 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:26.422705    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:42:26.486007 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:26.485968    2556 patch_prober.go:28] interesting pod/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Aug 04 00:42:26.486196 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:26.486035    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82" podUID="ee5a83b6-a67c-4e9e-957a-80f7a654961d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Aug 04 00:42:26.566483 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:26.566441    2556 scope.go:117] "RemoveContainer" containerID="a542c5fafa036d972266863baa0aa5528bd885c84488f2d37e9efa1c64413479"
Aug 04 00:42:27.486175 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:27.486128    2556 patch_prober.go:28] interesting pod/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Aug 04 00:42:27.486660 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:27.486198    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82" podUID="ee5a83b6-a67c-4e9e-957a-80f7a654961d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Aug 04 00:42:28.486297 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:28.486256    2556 patch_prober.go:28] interesting pod/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Aug 04 00:42:28.486759 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:28.486317    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82" podUID="ee5a83b6-a67c-4e9e-957a-80f7a654961d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Aug 04 00:42:29.486723 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:29.486680    2556 patch_prober.go:28] interesting pod/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Aug 04 00:42:29.487151 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:29.486790    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82" podUID="ee5a83b6-a67c-4e9e-957a-80f7a654961d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Aug 04 00:42:30.492628 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:30.492593    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:30.493123 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:30.492991    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:42:30.493659 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:42:30.493642    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:43:11.495233 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.495197    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"]
Aug 04 00:43:11.497782 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.497759    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:43:11.501924 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.501848    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-964853\"/\"test-model-964853-kserve-self-signed-certs\""
Aug 04 00:43:11.502228 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.502206    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-964853\"/\"openshift-service-ca.crt\""
Aug 04 00:43:11.502415 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.502214    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-964853\"/\"kube-root-ca.crt\""
Aug 04 00:43:11.502542 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.502525    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-964853\"/\"default-dockercfg-z6hbv\""
Aug 04 00:43:11.510350 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.510321    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"]
Aug 04 00:43:11.516470 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.516412    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5616722-75d3-4f96-bebb-22ae5a5d65b9-tmp-dir\") pod \"test-model-964853-kserve-59988bf575-5qb9k\" (UID: \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\") " pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:43:11.516664 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.516579    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkhvn\" (UniqueName: \"kubernetes.io/projected/d5616722-75d3-4f96-bebb-22ae5a5d65b9-kube-api-access-xkhvn\") pod \"test-model-964853-kserve-59988bf575-5qb9k\" (UID: \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\") " pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:43:11.516664 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.516617    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5616722-75d3-4f96-bebb-22ae5a5d65b9-home\") pod \"test-model-964853-kserve-59988bf575-5qb9k\" (UID: \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\") " pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:43:11.516807 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.516754    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5616722-75d3-4f96-bebb-22ae5a5d65b9-model-cache\") pod \"test-model-964853-kserve-59988bf575-5qb9k\" (UID: \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\") " pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:43:11.516875 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.516815    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5616722-75d3-4f96-bebb-22ae5a5d65b9-tls-certs\") pod \"test-model-964853-kserve-59988bf575-5qb9k\" (UID: \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\") " pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:43:11.516875 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.516857    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5616722-75d3-4f96-bebb-22ae5a5d65b9-dshm\") pod \"test-model-964853-kserve-59988bf575-5qb9k\" (UID: \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\") " pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:43:11.617913 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.617870    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5616722-75d3-4f96-bebb-22ae5a5d65b9-model-cache\") pod \"test-model-964853-kserve-59988bf575-5qb9k\" (UID: \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\") " pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:43:11.617913 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.617920    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5616722-75d3-4f96-bebb-22ae5a5d65b9-tls-certs\") pod \"test-model-964853-kserve-59988bf575-5qb9k\" (UID: \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\") " pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:43:11.618196 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.618037    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5616722-75d3-4f96-bebb-22ae5a5d65b9-dshm\") pod \"test-model-964853-kserve-59988bf575-5qb9k\" (UID: \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\") " pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:43:11.618196 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.618117    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5616722-75d3-4f96-bebb-22ae5a5d65b9-tmp-dir\") pod \"test-model-964853-kserve-59988bf575-5qb9k\" (UID: \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\") " pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:43:11.618196 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.618166    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkhvn\" (UniqueName: \"kubernetes.io/projected/d5616722-75d3-4f96-bebb-22ae5a5d65b9-kube-api-access-xkhvn\") pod \"test-model-964853-kserve-59988bf575-5qb9k\" (UID: \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\") " pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:43:11.618196 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.618186    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5616722-75d3-4f96-bebb-22ae5a5d65b9-home\") pod \"test-model-964853-kserve-59988bf575-5qb9k\" (UID: \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\") " pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:43:11.618427 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.618370    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5616722-75d3-4f96-bebb-22ae5a5d65b9-model-cache\") pod \"test-model-964853-kserve-59988bf575-5qb9k\" (UID: \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\") " pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:43:11.618491 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.618475    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5616722-75d3-4f96-bebb-22ae5a5d65b9-tmp-dir\") pod \"test-model-964853-kserve-59988bf575-5qb9k\" (UID: \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\") " pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:43:11.618557 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.618535    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5616722-75d3-4f96-bebb-22ae5a5d65b9-home\") pod \"test-model-964853-kserve-59988bf575-5qb9k\" (UID: \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\") " pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:43:11.620406 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.620379    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5616722-75d3-4f96-bebb-22ae5a5d65b9-dshm\") pod \"test-model-964853-kserve-59988bf575-5qb9k\" (UID: \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\") " pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:43:11.620665 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.620648    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5616722-75d3-4f96-bebb-22ae5a5d65b9-tls-certs\") pod \"test-model-964853-kserve-59988bf575-5qb9k\" (UID: \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\") " pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:43:11.626997 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.626967    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkhvn\" (UniqueName: \"kubernetes.io/projected/d5616722-75d3-4f96-bebb-22ae5a5d65b9-kube-api-access-xkhvn\") pod \"test-model-964853-kserve-59988bf575-5qb9k\" (UID: \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\") " pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:43:11.812208 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.812166    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:43:11.955338 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:11.955311    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"]
Aug 04 00:43:11.957934 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:43:11.957900    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5616722_75d3_4f96_bebb_22ae5a5d65b9.slice/crio-365cd05e8d7eafe80dbdaae7b239b0c1c09999905ff8f6e94173438ca5079633 WatchSource:0}: Error finding container 365cd05e8d7eafe80dbdaae7b239b0c1c09999905ff8f6e94173438ca5079633: Status 404 returned error can't find the container with id 365cd05e8d7eafe80dbdaae7b239b0c1c09999905ff8f6e94173438ca5079633
Aug 04 00:43:12.375488 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:12.375453    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k" event={"ID":"d5616722-75d3-4f96-bebb-22ae5a5d65b9","Type":"ContainerStarted","Data":"8bfef8846e5e879859d109a3d77ab130cb2058f3f9531e0676db999d7aba0727"}
Aug 04 00:43:12.375488 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:12.375494    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k" event={"ID":"d5616722-75d3-4f96-bebb-22ae5a5d65b9","Type":"ContainerStarted","Data":"365cd05e8d7eafe80dbdaae7b239b0c1c09999905ff8f6e94173438ca5079633"}
Aug 04 00:43:12.392800 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:12.392739    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k" podStartSLOduration=1.392709468 podStartE2EDuration="1.392709468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:43:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:43:12.390621371 +0000 UTC m=+2446.559258772" watchObservedRunningTime="2026-08-04 00:43:12.392709468 +0000 UTC m=+2446.561346837"
Aug 04 00:43:21.813098 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:21.813060    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:43:21.813606 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:21.813172    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:43:21.825981 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:21.825947    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:43:22.440755 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:22.440705    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:43:28.799216 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:28.799169    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"]
Aug 04 00:43:28.803357 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:28.803331    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:43:28.806679 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:28.806649    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-5d4def\"/\"openshift-service-ca.crt\""
Aug 04 00:43:28.806884 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:28.806649    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-5d4def\"/\"kube-root-ca.crt\""
Aug 04 00:43:28.806884 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:28.806656    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-5d4def\"/\"default-dockercfg-7k94f\""
Aug 04 00:43:28.806884 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:28.806654    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-5d4def\"/\"test-model-5d4def-kserve-self-signed-certs\""
Aug 04 00:43:28.811544 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:28.811518    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"]
Aug 04 00:43:28.897288 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:28.897252    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b97edee8-228a-4b02-9b48-f1f9f768e2ea-tls-certs\") pod \"test-model-5d4def-kserve-79584c6877-5v2vx\" (UID: \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\") " pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:43:28.897288 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:28.897305    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b97edee8-228a-4b02-9b48-f1f9f768e2ea-tmp-dir\") pod \"test-model-5d4def-kserve-79584c6877-5v2vx\" (UID: \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\") " pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:43:28.897562 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:28.897363    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b97edee8-228a-4b02-9b48-f1f9f768e2ea-dshm\") pod \"test-model-5d4def-kserve-79584c6877-5v2vx\" (UID: \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\") " pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:43:28.897562 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:28.897420    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b97edee8-228a-4b02-9b48-f1f9f768e2ea-home\") pod \"test-model-5d4def-kserve-79584c6877-5v2vx\" (UID: \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\") " pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:43:28.897562 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:28.897455    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccfc5\" (UniqueName: \"kubernetes.io/projected/b97edee8-228a-4b02-9b48-f1f9f768e2ea-kube-api-access-ccfc5\") pod \"test-model-5d4def-kserve-79584c6877-5v2vx\" (UID: \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\") " pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:43:28.897562 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:28.897491    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b97edee8-228a-4b02-9b48-f1f9f768e2ea-model-cache\") pod \"test-model-5d4def-kserve-79584c6877-5v2vx\" (UID: \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\") " pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:43:28.999063 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:28.999019    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b97edee8-228a-4b02-9b48-f1f9f768e2ea-tls-certs\") pod \"test-model-5d4def-kserve-79584c6877-5v2vx\" (UID: \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\") " pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:43:28.999063 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:28.999073    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b97edee8-228a-4b02-9b48-f1f9f768e2ea-tmp-dir\") pod \"test-model-5d4def-kserve-79584c6877-5v2vx\" (UID: \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\") " pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:43:28.999334 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:28.999094    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b97edee8-228a-4b02-9b48-f1f9f768e2ea-dshm\") pod \"test-model-5d4def-kserve-79584c6877-5v2vx\" (UID: \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\") " pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:43:28.999334 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:28.999120    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b97edee8-228a-4b02-9b48-f1f9f768e2ea-home\") pod \"test-model-5d4def-kserve-79584c6877-5v2vx\" (UID: \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\") " pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:43:28.999334 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:28.999141    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccfc5\" (UniqueName: \"kubernetes.io/projected/b97edee8-228a-4b02-9b48-f1f9f768e2ea-kube-api-access-ccfc5\") pod \"test-model-5d4def-kserve-79584c6877-5v2vx\" (UID: \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\") " pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:43:28.999334 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:28.999236    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b97edee8-228a-4b02-9b48-f1f9f768e2ea-model-cache\") pod \"test-model-5d4def-kserve-79584c6877-5v2vx\" (UID: \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\") " pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:43:28.999635 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:28.999614    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b97edee8-228a-4b02-9b48-f1f9f768e2ea-tmp-dir\") pod \"test-model-5d4def-kserve-79584c6877-5v2vx\" (UID: \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\") " pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:43:28.999757 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:28.999658    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b97edee8-228a-4b02-9b48-f1f9f768e2ea-home\") pod \"test-model-5d4def-kserve-79584c6877-5v2vx\" (UID: \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\") " pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:43:28.999757 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:28.999698    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b97edee8-228a-4b02-9b48-f1f9f768e2ea-model-cache\") pod \"test-model-5d4def-kserve-79584c6877-5v2vx\" (UID: \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\") " pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:43:29.001408 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:29.001389    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b97edee8-228a-4b02-9b48-f1f9f768e2ea-dshm\") pod \"test-model-5d4def-kserve-79584c6877-5v2vx\" (UID: \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\") " pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:43:29.001666 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:29.001650    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b97edee8-228a-4b02-9b48-f1f9f768e2ea-tls-certs\") pod \"test-model-5d4def-kserve-79584c6877-5v2vx\" (UID: \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\") " pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:43:29.007610 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:29.007587    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccfc5\" (UniqueName: \"kubernetes.io/projected/b97edee8-228a-4b02-9b48-f1f9f768e2ea-kube-api-access-ccfc5\") pod \"test-model-5d4def-kserve-79584c6877-5v2vx\" (UID: \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\") " pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:43:29.115633 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:29.115532    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:43:29.254835 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:29.254807    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"]
Aug 04 00:43:29.257868 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:43:29.257838    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb97edee8_228a_4b02_9b48_f1f9f768e2ea.slice/crio-3a15a83d8f96d33c4c14f089c2b69ee4f40635827877761673de26ccb13b3cf1 WatchSource:0}: Error finding container 3a15a83d8f96d33c4c14f089c2b69ee4f40635827877761673de26ccb13b3cf1: Status 404 returned error can't find the container with id 3a15a83d8f96d33c4c14f089c2b69ee4f40635827877761673de26ccb13b3cf1
Aug 04 00:43:29.469029 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:29.468933    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx" event={"ID":"b97edee8-228a-4b02-9b48-f1f9f768e2ea","Type":"ContainerStarted","Data":"7dfa6c599d0920f9a883b482117ad8544effc96d8f4ba06a76f1e94a8118bd8d"}
Aug 04 00:43:29.469029 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:29.468986    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx" event={"ID":"b97edee8-228a-4b02-9b48-f1f9f768e2ea","Type":"ContainerStarted","Data":"3a15a83d8f96d33c4c14f089c2b69ee4f40635827877761673de26ccb13b3cf1"}
Aug 04 00:43:29.487517 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:29.487455    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx" podStartSLOduration=1.487434752 podStartE2EDuration="1.487434752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:43:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:43:29.485396808 +0000 UTC m=+2463.654034180" watchObservedRunningTime="2026-08-04 00:43:29.487434752 +0000 UTC m=+2463.656072121"
Aug 04 00:43:39.116361 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:39.116318    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:43:39.116817 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:39.116376    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:43:39.128927 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:39.128903    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:43:39.533883 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:43:39.533849    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:44:07.390606 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:07.390568    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"]
Aug 04 00:44:08.309278 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:08.309245    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"]
Aug 04 00:44:22.410782 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.410670    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k" podUID="d5616722-75d3-4f96-bebb-22ae5a5d65b9" containerName="main" containerID="cri-o://8bfef8846e5e879859d109a3d77ab130cb2058f3f9531e0676db999d7aba0727" gracePeriod=45
Aug 04 00:44:22.429683 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.429646    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k" podUID="d5616722-75d3-4f96-bebb-22ae5a5d65b9" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": dial tcp 10.134.0.52:8000: connect: connection refused"
Aug 04 00:44:22.675375 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.675305    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:44:22.732580 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.732547    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkhvn\" (UniqueName: \"kubernetes.io/projected/d5616722-75d3-4f96-bebb-22ae5a5d65b9-kube-api-access-xkhvn\") pod \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\" (UID: \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\") "
Aug 04 00:44:22.732580 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.732585    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5616722-75d3-4f96-bebb-22ae5a5d65b9-model-cache\") pod \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\" (UID: \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\") "
Aug 04 00:44:22.732883 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.732637    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5616722-75d3-4f96-bebb-22ae5a5d65b9-home\") pod \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\" (UID: \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\") "
Aug 04 00:44:22.732883 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.732653    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5616722-75d3-4f96-bebb-22ae5a5d65b9-dshm\") pod \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\" (UID: \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\") "
Aug 04 00:44:22.732883 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.732762    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5616722-75d3-4f96-bebb-22ae5a5d65b9-tmp-dir\") pod \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\" (UID: \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\") "
Aug 04 00:44:22.732883 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.732801    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5616722-75d3-4f96-bebb-22ae5a5d65b9-tls-certs\") pod \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\" (UID: \"d5616722-75d3-4f96-bebb-22ae5a5d65b9\") "
Aug 04 00:44:22.733085 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.733007    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5616722-75d3-4f96-bebb-22ae5a5d65b9-home" (OuterVolumeSpecName: "home") pod "d5616722-75d3-4f96-bebb-22ae5a5d65b9" (UID: "d5616722-75d3-4f96-bebb-22ae5a5d65b9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:44:22.733085 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.732994    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5616722-75d3-4f96-bebb-22ae5a5d65b9-model-cache" (OuterVolumeSpecName: "model-cache") pod "d5616722-75d3-4f96-bebb-22ae5a5d65b9" (UID: "d5616722-75d3-4f96-bebb-22ae5a5d65b9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:44:22.733085 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.733059    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5616722-75d3-4f96-bebb-22ae5a5d65b9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d5616722-75d3-4f96-bebb-22ae5a5d65b9" (UID: "d5616722-75d3-4f96-bebb-22ae5a5d65b9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:44:22.733203 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.733119    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5616722-75d3-4f96-bebb-22ae5a5d65b9-tmp-dir\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:44:22.733203 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.733132    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5616722-75d3-4f96-bebb-22ae5a5d65b9-model-cache\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:44:22.733203 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.733143    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5616722-75d3-4f96-bebb-22ae5a5d65b9-home\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:44:22.735007 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.734981    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5616722-75d3-4f96-bebb-22ae5a5d65b9-dshm" (OuterVolumeSpecName: "dshm") pod "d5616722-75d3-4f96-bebb-22ae5a5d65b9" (UID: "d5616722-75d3-4f96-bebb-22ae5a5d65b9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:44:22.735007 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.734990    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5616722-75d3-4f96-bebb-22ae5a5d65b9-kube-api-access-xkhvn" (OuterVolumeSpecName: "kube-api-access-xkhvn") pod "d5616722-75d3-4f96-bebb-22ae5a5d65b9" (UID: "d5616722-75d3-4f96-bebb-22ae5a5d65b9"). InnerVolumeSpecName "kube-api-access-xkhvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:44:22.735128 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.735006    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5616722-75d3-4f96-bebb-22ae5a5d65b9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d5616722-75d3-4f96-bebb-22ae5a5d65b9" (UID: "d5616722-75d3-4f96-bebb-22ae5a5d65b9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:44:22.745834 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.745801    2556 generic.go:356] "Generic (PLEG): container finished" podID="d5616722-75d3-4f96-bebb-22ae5a5d65b9" containerID="8bfef8846e5e879859d109a3d77ab130cb2058f3f9531e0676db999d7aba0727" exitCode=0
Aug 04 00:44:22.745960 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.745849    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k" event={"ID":"d5616722-75d3-4f96-bebb-22ae5a5d65b9","Type":"ContainerDied","Data":"8bfef8846e5e879859d109a3d77ab130cb2058f3f9531e0676db999d7aba0727"}
Aug 04 00:44:22.745960 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.745862    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"
Aug 04 00:44:22.745960 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.745881    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k" event={"ID":"d5616722-75d3-4f96-bebb-22ae5a5d65b9","Type":"ContainerDied","Data":"365cd05e8d7eafe80dbdaae7b239b0c1c09999905ff8f6e94173438ca5079633"}
Aug 04 00:44:22.745960 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.745898    2556 scope.go:117] "RemoveContainer" containerID="8bfef8846e5e879859d109a3d77ab130cb2058f3f9531e0676db999d7aba0727"
Aug 04 00:44:22.758641 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.758621    2556 scope.go:117] "RemoveContainer" containerID="8bfef8846e5e879859d109a3d77ab130cb2058f3f9531e0676db999d7aba0727"
Aug 04 00:44:22.758989 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:44:22.758966    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bfef8846e5e879859d109a3d77ab130cb2058f3f9531e0676db999d7aba0727\": container with ID starting with 8bfef8846e5e879859d109a3d77ab130cb2058f3f9531e0676db999d7aba0727 not found: ID does not exist" containerID="8bfef8846e5e879859d109a3d77ab130cb2058f3f9531e0676db999d7aba0727"
Aug 04 00:44:22.759047 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.758998    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bfef8846e5e879859d109a3d77ab130cb2058f3f9531e0676db999d7aba0727"} err="failed to get container status \"8bfef8846e5e879859d109a3d77ab130cb2058f3f9531e0676db999d7aba0727\": rpc error: code = NotFound desc = could not find container \"8bfef8846e5e879859d109a3d77ab130cb2058f3f9531e0676db999d7aba0727\": container with ID starting with 8bfef8846e5e879859d109a3d77ab130cb2058f3f9531e0676db999d7aba0727 not found: ID does not exist"
Aug 04 00:44:22.769590 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.769552    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"]
Aug 04 00:44:22.773117 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.773086    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-964853/test-model-964853-kserve-59988bf575-5qb9k"]
Aug 04 00:44:22.834141 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.834105    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkhvn\" (UniqueName: \"kubernetes.io/projected/d5616722-75d3-4f96-bebb-22ae5a5d65b9-kube-api-access-xkhvn\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:44:22.834141 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.834137    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5616722-75d3-4f96-bebb-22ae5a5d65b9-dshm\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:44:22.834141 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:22.834148    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5616722-75d3-4f96-bebb-22ae5a5d65b9-tls-certs\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:44:23.329688 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.329641    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx" podUID="b97edee8-228a-4b02-9b48-f1f9f768e2ea" containerName="main" containerID="cri-o://7dfa6c599d0920f9a883b482117ad8544effc96d8f4ba06a76f1e94a8118bd8d" gracePeriod=45
Aug 04 00:44:23.587243 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.587167    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:44:23.642770 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.642710    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b97edee8-228a-4b02-9b48-f1f9f768e2ea-home\") pod \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\" (UID: \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\") "
Aug 04 00:44:23.642973 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.642819    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b97edee8-228a-4b02-9b48-f1f9f768e2ea-model-cache\") pod \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\" (UID: \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\") "
Aug 04 00:44:23.642973 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.642889    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b97edee8-228a-4b02-9b48-f1f9f768e2ea-dshm\") pod \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\" (UID: \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\") "
Aug 04 00:44:23.642973 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.642910    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b97edee8-228a-4b02-9b48-f1f9f768e2ea-tmp-dir\") pod \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\" (UID: \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\") "
Aug 04 00:44:23.642973 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.642933    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b97edee8-228a-4b02-9b48-f1f9f768e2ea-tls-certs\") pod \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\" (UID: \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\") "
Aug 04 00:44:23.643202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.642993    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccfc5\" (UniqueName: \"kubernetes.io/projected/b97edee8-228a-4b02-9b48-f1f9f768e2ea-kube-api-access-ccfc5\") pod \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\" (UID: \"b97edee8-228a-4b02-9b48-f1f9f768e2ea\") "
Aug 04 00:44:23.643202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.643022    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b97edee8-228a-4b02-9b48-f1f9f768e2ea-home" (OuterVolumeSpecName: "home") pod "b97edee8-228a-4b02-9b48-f1f9f768e2ea" (UID: "b97edee8-228a-4b02-9b48-f1f9f768e2ea"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:44:23.643202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.643181    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b97edee8-228a-4b02-9b48-f1f9f768e2ea-model-cache" (OuterVolumeSpecName: "model-cache") pod "b97edee8-228a-4b02-9b48-f1f9f768e2ea" (UID: "b97edee8-228a-4b02-9b48-f1f9f768e2ea"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:44:23.643349 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.643219    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b97edee8-228a-4b02-9b48-f1f9f768e2ea-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b97edee8-228a-4b02-9b48-f1f9f768e2ea" (UID: "b97edee8-228a-4b02-9b48-f1f9f768e2ea"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:44:23.643391 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.643349    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b97edee8-228a-4b02-9b48-f1f9f768e2ea-home\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:44:23.643391 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.643365    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b97edee8-228a-4b02-9b48-f1f9f768e2ea-model-cache\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:44:23.643391 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.643379    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b97edee8-228a-4b02-9b48-f1f9f768e2ea-tmp-dir\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:44:23.645266 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.645239    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b97edee8-228a-4b02-9b48-f1f9f768e2ea-dshm" (OuterVolumeSpecName: "dshm") pod "b97edee8-228a-4b02-9b48-f1f9f768e2ea" (UID: "b97edee8-228a-4b02-9b48-f1f9f768e2ea"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:44:23.645384 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.645359    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b97edee8-228a-4b02-9b48-f1f9f768e2ea-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b97edee8-228a-4b02-9b48-f1f9f768e2ea" (UID: "b97edee8-228a-4b02-9b48-f1f9f768e2ea"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:44:23.645429 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.645379    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b97edee8-228a-4b02-9b48-f1f9f768e2ea-kube-api-access-ccfc5" (OuterVolumeSpecName: "kube-api-access-ccfc5") pod "b97edee8-228a-4b02-9b48-f1f9f768e2ea" (UID: "b97edee8-228a-4b02-9b48-f1f9f768e2ea"). InnerVolumeSpecName "kube-api-access-ccfc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:44:23.744439 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.744385    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b97edee8-228a-4b02-9b48-f1f9f768e2ea-dshm\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:44:23.744439 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.744431    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b97edee8-228a-4b02-9b48-f1f9f768e2ea-tls-certs\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:44:23.744439 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.744445    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccfc5\" (UniqueName: \"kubernetes.io/projected/b97edee8-228a-4b02-9b48-f1f9f768e2ea-kube-api-access-ccfc5\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:44:23.752476 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.752442    2556 generic.go:356] "Generic (PLEG): container finished" podID="b97edee8-228a-4b02-9b48-f1f9f768e2ea" containerID="7dfa6c599d0920f9a883b482117ad8544effc96d8f4ba06a76f1e94a8118bd8d" exitCode=0
Aug 04 00:44:23.752646 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.752482    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"
Aug 04 00:44:23.752646 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.752525    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx" event={"ID":"b97edee8-228a-4b02-9b48-f1f9f768e2ea","Type":"ContainerDied","Data":"7dfa6c599d0920f9a883b482117ad8544effc96d8f4ba06a76f1e94a8118bd8d"}
Aug 04 00:44:23.752646 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.752567    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx" event={"ID":"b97edee8-228a-4b02-9b48-f1f9f768e2ea","Type":"ContainerDied","Data":"3a15a83d8f96d33c4c14f089c2b69ee4f40635827877761673de26ccb13b3cf1"}
Aug 04 00:44:23.752646 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.752587    2556 scope.go:117] "RemoveContainer" containerID="7dfa6c599d0920f9a883b482117ad8544effc96d8f4ba06a76f1e94a8118bd8d"
Aug 04 00:44:23.762076 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.762058    2556 scope.go:117] "RemoveContainer" containerID="7dfa6c599d0920f9a883b482117ad8544effc96d8f4ba06a76f1e94a8118bd8d"
Aug 04 00:44:23.762382 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:44:23.762359    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dfa6c599d0920f9a883b482117ad8544effc96d8f4ba06a76f1e94a8118bd8d\": container with ID starting with 7dfa6c599d0920f9a883b482117ad8544effc96d8f4ba06a76f1e94a8118bd8d not found: ID does not exist" containerID="7dfa6c599d0920f9a883b482117ad8544effc96d8f4ba06a76f1e94a8118bd8d"
Aug 04 00:44:23.762427 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.762393    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dfa6c599d0920f9a883b482117ad8544effc96d8f4ba06a76f1e94a8118bd8d"} err="failed to get container status \"7dfa6c599d0920f9a883b482117ad8544effc96d8f4ba06a76f1e94a8118bd8d\": rpc error: code = NotFound desc = could not find container \"7dfa6c599d0920f9a883b482117ad8544effc96d8f4ba06a76f1e94a8118bd8d\": container with ID starting with 7dfa6c599d0920f9a883b482117ad8544effc96d8f4ba06a76f1e94a8118bd8d not found: ID does not exist"
Aug 04 00:44:23.774598 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.774563    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"]
Aug 04 00:44:23.778900 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:23.778873    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-5d4def/test-model-5d4def-kserve-79584c6877-5v2vx"]
Aug 04 00:44:24.310195 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:24.310164    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b97edee8-228a-4b02-9b48-f1f9f768e2ea" path="/var/lib/kubelet/pods/b97edee8-228a-4b02-9b48-f1f9f768e2ea/volumes"
Aug 04 00:44:24.310610 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:24.310595    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5616722-75d3-4f96-bebb-22ae5a5d65b9" path="/var/lib/kubelet/pods/d5616722-75d3-4f96-bebb-22ae5a5d65b9/volumes"
Aug 04 00:44:25.447020 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:25.446986    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"]
Aug 04 00:44:25.447532 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:25.447217    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82" podUID="ee5a83b6-a67c-4e9e-957a-80f7a654961d" containerName="istio-proxy" containerID="cri-o://0ad757a0f440071119675af594dc160f0c104aed68011cfdcf6863ab600203a7" gracePeriod=30
Aug 04 00:44:30.494177 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.494138    2556 patch_prober.go:28] interesting pod/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Aug 04 00:44:30.494690 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.494200    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82" podUID="ee5a83b6-a67c-4e9e-957a-80f7a654961d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Aug 04 00:44:30.706007 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.705980    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:44:30.789966 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.789935    2556 generic.go:356] "Generic (PLEG): container finished" podID="ee5a83b6-a67c-4e9e-957a-80f7a654961d" containerID="0ad757a0f440071119675af594dc160f0c104aed68011cfdcf6863ab600203a7" exitCode=0
Aug 04 00:44:30.790154 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.789984    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"
Aug 04 00:44:30.790154 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.790012    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82" event={"ID":"ee5a83b6-a67c-4e9e-957a-80f7a654961d","Type":"ContainerDied","Data":"0ad757a0f440071119675af594dc160f0c104aed68011cfdcf6863ab600203a7"}
Aug 04 00:44:30.790154 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.790068    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82" event={"ID":"ee5a83b6-a67c-4e9e-957a-80f7a654961d","Type":"ContainerDied","Data":"61edf7bbf1e4177bde03e489a82fdc4e283c1a28c368baed8402c77a345c6dd3"}
Aug 04 00:44:30.790154 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.790094    2556 scope.go:117] "RemoveContainer" containerID="0ad757a0f440071119675af594dc160f0c104aed68011cfdcf6863ab600203a7"
Aug 04 00:44:30.799119 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.799100    2556 scope.go:117] "RemoveContainer" containerID="ff035abe6169f54087bd303ccced2e7d25fbcc7ee67090ed1901e85daa4c1390"
Aug 04 00:44:30.807346 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.807328    2556 scope.go:117] "RemoveContainer" containerID="0ad757a0f440071119675af594dc160f0c104aed68011cfdcf6863ab600203a7"
Aug 04 00:44:30.807582 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:44:30.807564    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ad757a0f440071119675af594dc160f0c104aed68011cfdcf6863ab600203a7\": container with ID starting with 0ad757a0f440071119675af594dc160f0c104aed68011cfdcf6863ab600203a7 not found: ID does not exist" containerID="0ad757a0f440071119675af594dc160f0c104aed68011cfdcf6863ab600203a7"
Aug 04 00:44:30.807634 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.807592    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ad757a0f440071119675af594dc160f0c104aed68011cfdcf6863ab600203a7"} err="failed to get container status \"0ad757a0f440071119675af594dc160f0c104aed68011cfdcf6863ab600203a7\": rpc error: code = NotFound desc = could not find container \"0ad757a0f440071119675af594dc160f0c104aed68011cfdcf6863ab600203a7\": container with ID starting with 0ad757a0f440071119675af594dc160f0c104aed68011cfdcf6863ab600203a7 not found: ID does not exist"
Aug 04 00:44:30.807634 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.807608    2556 scope.go:117] "RemoveContainer" containerID="ff035abe6169f54087bd303ccced2e7d25fbcc7ee67090ed1901e85daa4c1390"
Aug 04 00:44:30.807868 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:44:30.807850    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff035abe6169f54087bd303ccced2e7d25fbcc7ee67090ed1901e85daa4c1390\": container with ID starting with ff035abe6169f54087bd303ccced2e7d25fbcc7ee67090ed1901e85daa4c1390 not found: ID does not exist" containerID="ff035abe6169f54087bd303ccced2e7d25fbcc7ee67090ed1901e85daa4c1390"
Aug 04 00:44:30.807917 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.807878    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff035abe6169f54087bd303ccced2e7d25fbcc7ee67090ed1901e85daa4c1390"} err="failed to get container status \"ff035abe6169f54087bd303ccced2e7d25fbcc7ee67090ed1901e85daa4c1390\": rpc error: code = NotFound desc = could not find container \"ff035abe6169f54087bd303ccced2e7d25fbcc7ee67090ed1901e85daa4c1390\": container with ID starting with ff035abe6169f54087bd303ccced2e7d25fbcc7ee67090ed1901e85daa4c1390 not found: ID does not exist"
Aug 04 00:44:30.813196 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.813172    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlqpk\" (UniqueName: \"kubernetes.io/projected/ee5a83b6-a67c-4e9e-957a-80f7a654961d-kube-api-access-mlqpk\") pod \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") "
Aug 04 00:44:30.813286 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.813226    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-workload-socket\") pod \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") "
Aug 04 00:44:30.813286 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.813250    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istio-data\") pod \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") "
Aug 04 00:44:30.813286 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.813273    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-credential-socket\") pod \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") "
Aug 04 00:44:30.813430 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.813322    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istio-podinfo\") pod \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") "
Aug 04 00:44:30.813430 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.813390    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istio-token\") pod \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") "
Aug 04 00:44:30.813533 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.813430    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istio-envoy\") pod \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") "
Aug 04 00:44:30.813533 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.813454    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ee5a83b6-a67c-4e9e-957a-80f7a654961d" (UID: "ee5a83b6-a67c-4e9e-957a-80f7a654961d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:44:30.813533 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.813485    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istiod-ca-cert\") pod \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") "
Aug 04 00:44:30.813533 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.813511    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-workload-certs\") pod \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\" (UID: \"ee5a83b6-a67c-4e9e-957a-80f7a654961d\") "
Aug 04 00:44:30.813752 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.813583    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ee5a83b6-a67c-4e9e-957a-80f7a654961d" (UID: "ee5a83b6-a67c-4e9e-957a-80f7a654961d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:44:30.813752 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.813621    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istio-data" (OuterVolumeSpecName: "istio-data") pod "ee5a83b6-a67c-4e9e-957a-80f7a654961d" (UID: "ee5a83b6-a67c-4e9e-957a-80f7a654961d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:44:30.813881 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.813858    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ee5a83b6-a67c-4e9e-957a-80f7a654961d" (UID: "ee5a83b6-a67c-4e9e-957a-80f7a654961d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:44:30.813881 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.813868    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ee5a83b6-a67c-4e9e-957a-80f7a654961d" (UID: "ee5a83b6-a67c-4e9e-957a-80f7a654961d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:44:30.814001 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.813895    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-workload-socket\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:44:30.814001 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.813910    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istio-data\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:44:30.814001 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.813919    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-credential-socket\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:44:30.815665 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.815641    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istio-token" (OuterVolumeSpecName: "istio-token") pod "ee5a83b6-a67c-4e9e-957a-80f7a654961d" (UID: "ee5a83b6-a67c-4e9e-957a-80f7a654961d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:44:30.815665 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.815657    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee5a83b6-a67c-4e9e-957a-80f7a654961d-kube-api-access-mlqpk" (OuterVolumeSpecName: "kube-api-access-mlqpk") pod "ee5a83b6-a67c-4e9e-957a-80f7a654961d" (UID: "ee5a83b6-a67c-4e9e-957a-80f7a654961d"). InnerVolumeSpecName "kube-api-access-mlqpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:44:30.815861 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.815667    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ee5a83b6-a67c-4e9e-957a-80f7a654961d" (UID: "ee5a83b6-a67c-4e9e-957a-80f7a654961d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 00:44:30.815861 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.815813    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ee5a83b6-a67c-4e9e-957a-80f7a654961d" (UID: "ee5a83b6-a67c-4e9e-957a-80f7a654961d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:44:30.914949 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.914913    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istio-podinfo\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:44:30.914949 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.914943    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istio-token\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:44:30.914949 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.914952    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istio-envoy\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:44:30.914949 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.914959    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee5a83b6-a67c-4e9e-957a-80f7a654961d-istiod-ca-cert\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:44:30.915240 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.914967    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee5a83b6-a67c-4e9e-957a-80f7a654961d-workload-certs\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:44:30.915240 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:30.914975    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlqpk\" (UniqueName: \"kubernetes.io/projected/ee5a83b6-a67c-4e9e-957a-80f7a654961d-kube-api-access-mlqpk\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:44:31.112542 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:31.112503    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"]
Aug 04 00:44:31.115775 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:31.115744    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-964853-openshift-default-75bbc8c77b-d4s82"]
Aug 04 00:44:32.307075 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:32.307035    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee5a83b6-a67c-4e9e-957a-80f7a654961d" path="/var/lib/kubelet/pods/ee5a83b6-a67c-4e9e-957a-80f7a654961d/volumes"
Aug 04 00:44:43.707739 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.707683    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"]
Aug 04 00:44:43.708166 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.708140    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee5a83b6-a67c-4e9e-957a-80f7a654961d" containerName="istio-proxy"
Aug 04 00:44:43.708166 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.708154    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee5a83b6-a67c-4e9e-957a-80f7a654961d" containerName="istio-proxy"
Aug 04 00:44:43.708254 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.708175    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5616722-75d3-4f96-bebb-22ae5a5d65b9" containerName="main"
Aug 04 00:44:43.708254 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.708180    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5616722-75d3-4f96-bebb-22ae5a5d65b9" containerName="main"
Aug 04 00:44:43.708254 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.708188    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee5a83b6-a67c-4e9e-957a-80f7a654961d" containerName="istio-proxy"
Aug 04 00:44:43.708254 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.708194    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee5a83b6-a67c-4e9e-957a-80f7a654961d" containerName="istio-proxy"
Aug 04 00:44:43.708254 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.708199    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b97edee8-228a-4b02-9b48-f1f9f768e2ea" containerName="main"
Aug 04 00:44:43.708254 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.708206    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b97edee8-228a-4b02-9b48-f1f9f768e2ea" containerName="main"
Aug 04 00:44:43.708464 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.708278    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5616722-75d3-4f96-bebb-22ae5a5d65b9" containerName="main"
Aug 04 00:44:43.708464 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.708286    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee5a83b6-a67c-4e9e-957a-80f7a654961d" containerName="istio-proxy"
Aug 04 00:44:43.708464 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.708294    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee5a83b6-a67c-4e9e-957a-80f7a654961d" containerName="istio-proxy"
Aug 04 00:44:43.708464 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.708302    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b97edee8-228a-4b02-9b48-f1f9f768e2ea" containerName="main"
Aug 04 00:44:43.711653 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.711628    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.714060 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.714040    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-b26f4b-openshift-default-dockercfg-rgdm4\""
Aug 04 00:44:43.723225 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.723198    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"]
Aug 04 00:44:43.838764 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.838700    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istio-envoy\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.838764 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.838768    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr9f7\" (UniqueName: \"kubernetes.io/projected/3299d13a-1a43-47d9-bd9e-8aa9891c9305-kube-api-access-jr9f7\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.839059 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.838795    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-workload-certs\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.839059 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.838815    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istio-token\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.839059 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.838830    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istiod-ca-cert\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.839059 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.838851    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istio-data\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.839059 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.838918    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-workload-socket\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.839059 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.838979    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istio-podinfo\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.839318 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.839097    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-credential-socket\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.940518 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.940473    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istio-envoy\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.940518 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.940515    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr9f7\" (UniqueName: \"kubernetes.io/projected/3299d13a-1a43-47d9-bd9e-8aa9891c9305-kube-api-access-jr9f7\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.940850 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.940537    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-workload-certs\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.940850 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.940560    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istio-token\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.940850 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.940586    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istiod-ca-cert\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.940850 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.940616    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istio-data\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.940850 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.940643    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-workload-socket\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.941112 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.940857    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istio-podinfo\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.941112 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.941004    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-credential-socket\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.941112 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.941035    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-workload-certs\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.941260 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.941141    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istio-data\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.941260 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.941198    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-workload-socket\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.941427 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.941402    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-credential-socket\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.941501 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.941424    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istiod-ca-cert\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.942969 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.942942    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istio-envoy\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.943387 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.943368    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istio-podinfo\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.949035 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.949006    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istio-token\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:43.949184 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:43.949167    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr9f7\" (UniqueName: \"kubernetes.io/projected/3299d13a-1a43-47d9-bd9e-8aa9891c9305-kube-api-access-jr9f7\") pod \"e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") " pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:44.023381 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:44.023349    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:44.203477 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:44.203446    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"]
Aug 04 00:44:44.205589 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:44:44.205549    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3299d13a_1a43_47d9_bd9e_8aa9891c9305.slice/crio-03a2a03ff0e2544d6c2d70e0f3cd9dca1b7a7e8360eab3dddbafccaa5f58c6c7 WatchSource:0}: Error finding container 03a2a03ff0e2544d6c2d70e0f3cd9dca1b7a7e8360eab3dddbafccaa5f58c6c7: Status 404 returned error can't find the container with id 03a2a03ff0e2544d6c2d70e0f3cd9dca1b7a7e8360eab3dddbafccaa5f58c6c7
Aug 04 00:44:44.208134 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:44.208095    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:44:44.208230 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:44.208177    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:44:44.208230 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:44.208214    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:44:44.865632 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:44.865589    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq" event={"ID":"3299d13a-1a43-47d9-bd9e-8aa9891c9305","Type":"ContainerStarted","Data":"e1f840fec0b77303be7c22d726b44cfc8d08051ff6ffb78f6d29a3d045b02dce"}
Aug 04 00:44:44.866062 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:44.865650    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq" event={"ID":"3299d13a-1a43-47d9-bd9e-8aa9891c9305","Type":"ContainerStarted","Data":"03a2a03ff0e2544d6c2d70e0f3cd9dca1b7a7e8360eab3dddbafccaa5f58c6c7"}
Aug 04 00:44:44.885662 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:44.885601    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq" podStartSLOduration=1.885583332 podStartE2EDuration="1.885583332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:44:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:44:44.883879237 +0000 UTC m=+2539.052516606" watchObservedRunningTime="2026-08-04 00:44:44.885583332 +0000 UTC m=+2539.054220756"
Aug 04 00:44:45.024320 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:45.024276    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:45.029866 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:45.029836    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:45.871565 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:45.871531    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:44:45.872655 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:44:45.872638    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:45:00.129157 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.129120    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-b26f4b-29763405-22tt2"]
Aug 04 00:45:00.131849 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.131814    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-b26f4b-29763405-22tt2"
Aug 04 00:45:00.132624 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.132597    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763405-lzkdh"]
Aug 04 00:45:00.134182 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.134161    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8db7m\""
Aug 04 00:45:00.135051 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.135030    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763405-lzkdh"
Aug 04 00:45:00.158511 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.143265    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-b26f4b-29763405-22tt2"]
Aug 04 00:45:00.158511 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.146286    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-b26f4b-29763405-22tt2"
Aug 04 00:45:00.158511 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.154634    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763405-lzkdh"
Aug 04 00:45:00.160741 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.160694    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763405-lzkdh"]
Aug 04 00:45:00.314439 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.314413    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-b26f4b-29763405-22tt2"]
Aug 04 00:45:00.333757 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:45:00.333725    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod983c679e_5743_4d1f_92a1_a875ee5a59f7.slice/crio-64460fa12758d88f6b30b81aab1f9499ad2028f37d5f12592485667d51446192 WatchSource:0}: Error finding container 64460fa12758d88f6b30b81aab1f9499ad2028f37d5f12592485667d51446192: Status 404 returned error can't find the container with id 64460fa12758d88f6b30b81aab1f9499ad2028f37d5f12592485667d51446192
Aug 04 00:45:00.340667 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.340644    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763405-lzkdh"]
Aug 04 00:45:00.344390 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:45:00.344363    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb88adf_e843_49be_a344_b79b76b8a7f6.slice/crio-6e5df01a17040f3b9290e921426e758284580bccbc42ee91c6fd94b9e4ceb09d WatchSource:0}: Error finding container 6e5df01a17040f3b9290e921426e758284580bccbc42ee91c6fd94b9e4ceb09d: Status 404 returned error can't find the container with id 6e5df01a17040f3b9290e921426e758284580bccbc42ee91c6fd94b9e4ceb09d
Aug 04 00:45:00.872824 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.872709    2556 patch_prober.go:28] interesting pod/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Aug 04 00:45:00.872824 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.872789    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq" podUID="3299d13a-1a43-47d9-bd9e-8aa9891c9305" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Aug 04 00:45:00.950468 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.950422    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763405-lzkdh" event={"ID":"2fb88adf-e843-49be-a344-b79b76b8a7f6","Type":"ContainerStarted","Data":"9373ad241a2aefa51a5bccc472909c12035e484dde143b47c1a21694ae823a59"}
Aug 04 00:45:00.950675 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.950494    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763405-lzkdh" event={"ID":"2fb88adf-e843-49be-a344-b79b76b8a7f6","Type":"ContainerStarted","Data":"6e5df01a17040f3b9290e921426e758284580bccbc42ee91c6fd94b9e4ceb09d"}
Aug 04 00:45:00.951883 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.951859    2556 generic.go:356] "Generic (PLEG): container finished" podID="3299d13a-1a43-47d9-bd9e-8aa9891c9305" containerID="e1f840fec0b77303be7c22d726b44cfc8d08051ff6ffb78f6d29a3d045b02dce" exitCode=0
Aug 04 00:45:00.951991 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.951926    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq" event={"ID":"3299d13a-1a43-47d9-bd9e-8aa9891c9305","Type":"ContainerDied","Data":"e1f840fec0b77303be7c22d726b44cfc8d08051ff6ffb78f6d29a3d045b02dce"}
Aug 04 00:45:00.952286 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.952270    2556 scope.go:117] "RemoveContainer" containerID="e1f840fec0b77303be7c22d726b44cfc8d08051ff6ffb78f6d29a3d045b02dce"
Aug 04 00:45:00.953343 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.953310    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:45:00.953426 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.953394    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:45:00.953479 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.953418    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-b26f4b-29763405-22tt2" event={"ID":"983c679e-5743-4d1f-92a1-a875ee5a59f7","Type":"ContainerStarted","Data":"61fcca1b138befe4e2971e35facdeb9170a8bff15eeb3d07b494134645d6f395"}
Aug 04 00:45:00.953479 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.953440    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:45:00.953479 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.953466    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-b26f4b-29763405-22tt2" event={"ID":"983c679e-5743-4d1f-92a1-a875ee5a59f7","Type":"ContainerStarted","Data":"64460fa12758d88f6b30b81aab1f9499ad2028f37d5f12592485667d51446192"}
Aug 04 00:45:00.964346 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.964305    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763405-lzkdh" podStartSLOduration=0.964290913 podStartE2EDuration="964.290913ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:45:00.963445756 +0000 UTC m=+2555.132083128" watchObservedRunningTime="2026-08-04 00:45:00.964290913 +0000 UTC m=+2555.132928282"
Aug 04 00:45:00.995875 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:00.995814    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-b26f4b-29763405-22tt2" podStartSLOduration=0.995791448 podStartE2EDuration="995.791448ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:45:00.9946313 +0000 UTC m=+2555.163268672" watchObservedRunningTime="2026-08-04 00:45:00.995791448 +0000 UTC m=+2555.164428820"
Aug 04 00:45:01.964097 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:01.964049    2556 generic.go:356] "Generic (PLEG): container finished" podID="2fb88adf-e843-49be-a344-b79b76b8a7f6" containerID="9373ad241a2aefa51a5bccc472909c12035e484dde143b47c1a21694ae823a59" exitCode=0
Aug 04 00:45:01.964577 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:01.964519    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763405-lzkdh" event={"ID":"2fb88adf-e843-49be-a344-b79b76b8a7f6","Type":"ContainerDied","Data":"9373ad241a2aefa51a5bccc472909c12035e484dde143b47c1a21694ae823a59"}
Aug 04 00:45:01.968167 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:01.968129    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq" event={"ID":"3299d13a-1a43-47d9-bd9e-8aa9891c9305","Type":"ContainerStarted","Data":"f1a97a7688ec12d86508dfb5905dc8f121641099270099acaefc99c1a040be34"}
Aug 04 00:45:01.969813 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:01.969781    2556 generic.go:356] "Generic (PLEG): container finished" podID="983c679e-5743-4d1f-92a1-a875ee5a59f7" containerID="61fcca1b138befe4e2971e35facdeb9170a8bff15eeb3d07b494134645d6f395" exitCode=0
Aug 04 00:45:01.969941 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:01.969861    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-b26f4b-29763405-22tt2" event={"ID":"983c679e-5743-4d1f-92a1-a875ee5a59f7","Type":"ContainerDied","Data":"61fcca1b138befe4e2971e35facdeb9170a8bff15eeb3d07b494134645d6f395"}
Aug 04 00:45:02.023872 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:02.023832    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:45:02.024098 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:02.024077    2556 patch_prober.go:28] interesting pod/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Aug 04 00:45:02.024207 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:02.024127    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq" podUID="3299d13a-1a43-47d9-bd9e-8aa9891c9305" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Aug 04 00:45:03.023960 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:03.023925    2556 patch_prober.go:28] interesting pod/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Aug 04 00:45:03.024434 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:03.023979    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq" podUID="3299d13a-1a43-47d9-bd9e-8aa9891c9305" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Aug 04 00:45:03.170536 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:03.170508    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763405-lzkdh"
Aug 04 00:45:03.174165 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:03.174142    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-b26f4b-29763405-22tt2"
Aug 04 00:45:03.981300 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:03.981262    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763405-lzkdh"
Aug 04 00:45:03.981300 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:03.981281    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29763405-lzkdh" event={"ID":"2fb88adf-e843-49be-a344-b79b76b8a7f6","Type":"ContainerDied","Data":"6e5df01a17040f3b9290e921426e758284580bccbc42ee91c6fd94b9e4ceb09d"}
Aug 04 00:45:03.981554 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:03.981325    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e5df01a17040f3b9290e921426e758284580bccbc42ee91c6fd94b9e4ceb09d"
Aug 04 00:45:03.982611 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:03.982578    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-b26f4b-29763405-22tt2" event={"ID":"983c679e-5743-4d1f-92a1-a875ee5a59f7","Type":"ContainerDied","Data":"64460fa12758d88f6b30b81aab1f9499ad2028f37d5f12592485667d51446192"}
Aug 04 00:45:03.982774 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:03.982630    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64460fa12758d88f6b30b81aab1f9499ad2028f37d5f12592485667d51446192"
Aug 04 00:45:03.982774 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:03.982584    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-b26f4b-29763405-22tt2"
Aug 04 00:45:04.024487 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:04.024450    2556 patch_prober.go:28] interesting pod/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Aug 04 00:45:04.024913 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:04.024509    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq" podUID="3299d13a-1a43-47d9-bd9e-8aa9891c9305" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Aug 04 00:45:05.024282 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:05.024243    2556 patch_prober.go:28] interesting pod/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Aug 04 00:45:05.024446 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:05.024299    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq" podUID="3299d13a-1a43-47d9-bd9e-8aa9891c9305" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Aug 04 00:45:06.023952 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:06.023910    2556 patch_prober.go:28] interesting pod/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Aug 04 00:45:06.024334 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:06.023971    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq" podUID="3299d13a-1a43-47d9-bd9e-8aa9891c9305" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Aug 04 00:45:07.024340 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:07.024299    2556 patch_prober.go:28] interesting pod/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Aug 04 00:45:07.024801 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:07.024356    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq" podUID="3299d13a-1a43-47d9-bd9e-8aa9891c9305" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Aug 04 00:45:08.027971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:08.027935    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:45:08.028451 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:08.028350    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:45:08.029098 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:08.029076    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:45:12.443679 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.443639    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"]
Aug 04 00:45:12.444419 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.444270    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="983c679e-5743-4d1f-92a1-a875ee5a59f7" containerName="cleanup"
Aug 04 00:45:12.444419 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.444293    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="983c679e-5743-4d1f-92a1-a875ee5a59f7" containerName="cleanup"
Aug 04 00:45:12.444419 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.444307    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fb88adf-e843-49be-a344-b79b76b8a7f6" containerName="cleanup"
Aug 04 00:45:12.444419 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.444313    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fb88adf-e843-49be-a344-b79b76b8a7f6" containerName="cleanup"
Aug 04 00:45:12.444419 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.444410    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fb88adf-e843-49be-a344-b79b76b8a7f6" containerName="cleanup"
Aug 04 00:45:12.444419 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.444424    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="983c679e-5743-4d1f-92a1-a875ee5a59f7" containerName="cleanup"
Aug 04 00:45:12.446847 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.446826    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.449309 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.449286    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-907df3-openshift-default-dockercfg-98l2w\""
Aug 04 00:45:12.459652 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.459619    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"]
Aug 04 00:45:12.545121 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.545077    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-workload-socket\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.545121 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.545122    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istiod-ca-cert\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.545363 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.545152    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istio-envoy\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.545363 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.545188    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istio-data\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.545363 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.545241    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-credential-socket\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.545363 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.545275    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istio-token\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.545363 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.545340    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-workload-certs\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.545556 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.545369    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lxkn\" (UniqueName: \"kubernetes.io/projected/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-kube-api-access-9lxkn\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.545556 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.545450    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istio-podinfo\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.646478 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.646425    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istio-podinfo\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.646653 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.646514    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-workload-socket\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.646653 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.646540    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istiod-ca-cert\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.646653 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.646569    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istio-envoy\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.646653 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.646601    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istio-data\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.646653 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.646641    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-credential-socket\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.646964 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.646677    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istio-token\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.646964 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.646747    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-workload-certs\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.646964 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.646796    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lxkn\" (UniqueName: \"kubernetes.io/projected/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-kube-api-access-9lxkn\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.647127 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.647045    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-workload-socket\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.647328 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.647304    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istio-data\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.647423 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.647313    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-workload-certs\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.647491 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.647446    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istiod-ca-cert\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.647529 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.647505    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-credential-socket\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.649147 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.649119    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istio-envoy\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.649420 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.649401    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istio-podinfo\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.654665 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.654639    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istio-token\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.654877 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.654858    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lxkn\" (UniqueName: \"kubernetes.io/projected/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-kube-api-access-9lxkn\") pod \"e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") " pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.758437 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.758398    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:12.903377 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.903319    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"]
Aug 04 00:45:12.905567 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:45:12.905534    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8a36c84_2d8c_43eb_94c5_6f0e0cfd886e.slice/crio-3fee9f5a719514a5c2af624018536e9ccdce3bba195f840506889d9697148562 WatchSource:0}: Error finding container 3fee9f5a719514a5c2af624018536e9ccdce3bba195f840506889d9697148562: Status 404 returned error can't find the container with id 3fee9f5a719514a5c2af624018536e9ccdce3bba195f840506889d9697148562
Aug 04 00:45:12.908015 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.907982    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:45:12.908103 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.908052    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:45:12.908103 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:12.908082    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:45:13.039892 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:13.039778    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs" event={"ID":"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e","Type":"ContainerStarted","Data":"c817f8d6ecf8d4a3cc7671dc9eda6fc86547c7cbc3763b6e4ec9477cb3c26baa"}
Aug 04 00:45:13.040062 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:13.039902    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs" event={"ID":"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e","Type":"ContainerStarted","Data":"3fee9f5a719514a5c2af624018536e9ccdce3bba195f840506889d9697148562"}
Aug 04 00:45:13.073838 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:13.073776    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs" podStartSLOduration=1.07375841 podStartE2EDuration="1.07375841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:45:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:45:13.071911973 +0000 UTC m=+2567.240549358" watchObservedRunningTime="2026-08-04 00:45:13.07375841 +0000 UTC m=+2567.242395780"
Aug 04 00:45:13.759055 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:13.759016    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:13.764209 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:13.764181    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:14.045154 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:14.045059    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:14.046087 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:14.046061    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:29.274489 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:29.274443    2556 patch_prober.go:28] interesting pod/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": read tcp 10.134.0.2:35546->10.134.0.57:15021: read: connection reset by peer" start-of-body=
Aug 04 00:45:29.275212 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:29.274533    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs" podUID="d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": read tcp 10.134.0.2:35546->10.134.0.57:15021: read: connection reset by peer"
Aug 04 00:45:30.128651 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:30.128616    2556 generic.go:356] "Generic (PLEG): container finished" podID="d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" containerID="c817f8d6ecf8d4a3cc7671dc9eda6fc86547c7cbc3763b6e4ec9477cb3c26baa" exitCode=0
Aug 04 00:45:30.128880 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:30.128692    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs" event={"ID":"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e","Type":"ContainerDied","Data":"c817f8d6ecf8d4a3cc7671dc9eda6fc86547c7cbc3763b6e4ec9477cb3c26baa"}
Aug 04 00:45:30.129188 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:30.129171    2556 scope.go:117] "RemoveContainer" containerID="c817f8d6ecf8d4a3cc7671dc9eda6fc86547c7cbc3763b6e4ec9477cb3c26baa"
Aug 04 00:45:30.130243 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:30.130214    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:45:30.130327 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:30.130285    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:45:30.130327 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:30.130319    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:45:31.135682 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:31.135641    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs" event={"ID":"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e","Type":"ContainerStarted","Data":"db333b52549a5d976be0d1082e3ac88d8744dbabbc4b90bb1f06907e55bc341a"}
Aug 04 00:45:31.759692 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:31.759653    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:31.760168 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:31.760064    2556 patch_prober.go:28] interesting pod/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Aug 04 00:45:31.760339 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:31.760316    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs" podUID="d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Aug 04 00:45:32.759248 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:32.759202    2556 patch_prober.go:28] interesting pod/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Aug 04 00:45:32.759942 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:32.759285    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs" podUID="d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Aug 04 00:45:33.759067 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:33.759014    2556 patch_prober.go:28] interesting pod/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Aug 04 00:45:33.759298 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:33.759103    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs" podUID="d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Aug 04 00:45:34.759474 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:34.759422    2556 patch_prober.go:28] interesting pod/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Aug 04 00:45:34.760031 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:34.759507    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs" podUID="d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Aug 04 00:45:35.759299 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:35.759260    2556 patch_prober.go:28] interesting pod/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Aug 04 00:45:35.759657 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:35.759614    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs" podUID="d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Aug 04 00:45:36.763458 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:36.763427    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:36.764005 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:36.763849    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:36.764512 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:36.764493    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:45:42.820278 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:42.820241    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b26f4b-dlxrw"]
Aug 04 00:45:42.824021 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:42.823999    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b26f4b-dlxrw"
Aug 04 00:45:42.826556 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:42.826536    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8db7m\""
Aug 04 00:45:42.830346 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:42.830320    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b26f4b-dlxrw"]
Aug 04 00:45:42.861959 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:42.861923    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc33db69-85b8-48b6-9a0e-8109e5d87b3d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-b26f4b-dlxrw\" (UID: \"dc33db69-85b8-48b6-9a0e-8109e5d87b3d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b26f4b-dlxrw"
Aug 04 00:45:42.962837 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:42.962801    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc33db69-85b8-48b6-9a0e-8109e5d87b3d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-b26f4b-dlxrw\" (UID: \"dc33db69-85b8-48b6-9a0e-8109e5d87b3d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b26f4b-dlxrw"
Aug 04 00:45:42.963448 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:42.963424    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc33db69-85b8-48b6-9a0e-8109e5d87b3d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-b26f4b-dlxrw\" (UID: \"dc33db69-85b8-48b6-9a0e-8109e5d87b3d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b26f4b-dlxrw"
Aug 04 00:45:43.137331 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:43.137246    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b26f4b-dlxrw"
Aug 04 00:45:43.278442 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:43.278413    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b26f4b-dlxrw"]
Aug 04 00:45:43.280805 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:45:43.280768    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc33db69_85b8_48b6_9a0e_8109e5d87b3d.slice/crio-a157a70c8d97397e32565fd38b9f1ddd475ccad8d1c47dea918df8f2741c4c1b WatchSource:0}: Error finding container a157a70c8d97397e32565fd38b9f1ddd475ccad8d1c47dea918df8f2741c4c1b: Status 404 returned error can't find the container with id a157a70c8d97397e32565fd38b9f1ddd475ccad8d1c47dea918df8f2741c4c1b
Aug 04 00:45:44.217834 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:44.217737    2556 generic.go:356] "Generic (PLEG): container finished" podID="dc33db69-85b8-48b6-9a0e-8109e5d87b3d" containerID="35cd88cf63894c6ea1c85b2402229a9a8797879772a5bab192a4aea39ef5b630" exitCode=0
Aug 04 00:45:44.218202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:44.217832    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b26f4b-dlxrw" event={"ID":"dc33db69-85b8-48b6-9a0e-8109e5d87b3d","Type":"ContainerDied","Data":"35cd88cf63894c6ea1c85b2402229a9a8797879772a5bab192a4aea39ef5b630"}
Aug 04 00:45:44.218202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:44.217892    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b26f4b-dlxrw" event={"ID":"dc33db69-85b8-48b6-9a0e-8109e5d87b3d","Type":"ContainerStarted","Data":"a157a70c8d97397e32565fd38b9f1ddd475ccad8d1c47dea918df8f2741c4c1b"}
Aug 04 00:45:45.358340 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:45.358311    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b26f4b-dlxrw"
Aug 04 00:45:45.487521 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:45.487421    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc33db69-85b8-48b6-9a0e-8109e5d87b3d-maas-api-service-ca\") pod \"dc33db69-85b8-48b6-9a0e-8109e5d87b3d\" (UID: \"dc33db69-85b8-48b6-9a0e-8109e5d87b3d\") "
Aug 04 00:45:45.487848 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:45.487825    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc33db69-85b8-48b6-9a0e-8109e5d87b3d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dc33db69-85b8-48b6-9a0e-8109e5d87b3d" (UID: "dc33db69-85b8-48b6-9a0e-8109e5d87b3d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:45:45.588521 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:45.588485    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc33db69-85b8-48b6-9a0e-8109e5d87b3d-maas-api-service-ca\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:45:46.228744 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:46.228698    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b26f4b-dlxrw"
Aug 04 00:45:46.228744 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:46.228739    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b26f4b-dlxrw" event={"ID":"dc33db69-85b8-48b6-9a0e-8109e5d87b3d","Type":"ContainerDied","Data":"a157a70c8d97397e32565fd38b9f1ddd475ccad8d1c47dea918df8f2741c4c1b"}
Aug 04 00:45:46.228966 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:46.228788    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a157a70c8d97397e32565fd38b9f1ddd475ccad8d1c47dea918df8f2741c4c1b"
Aug 04 00:45:58.250698 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:58.250658    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-b26f4b-29763405-22tt2"]
Aug 04 00:45:58.258384 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:58.254193    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-b26f4b-29763405-22tt2"]
Aug 04 00:45:58.308365 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:58.308325    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="983c679e-5743-4d1f-92a1-a875ee5a59f7" path="/var/lib/kubelet/pods/983c679e-5743-4d1f-92a1-a875ee5a59f7/volumes"
Aug 04 00:45:58.428882 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:58.428844    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b26f4b-dlxrw"]
Aug 04 00:45:58.432511 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:45:58.432479    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b26f4b-dlxrw"]
Aug 04 00:46:00.308137 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:00.308101    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc33db69-85b8-48b6-9a0e-8109e5d87b3d" path="/var/lib/kubelet/pods/dc33db69-85b8-48b6-9a0e-8109e5d87b3d/volumes"
Aug 04 00:46:04.847143 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:04.847103    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"]
Aug 04 00:46:04.847669 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:04.847390    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq" podUID="3299d13a-1a43-47d9-bd9e-8aa9891c9305" containerName="istio-proxy" containerID="cri-o://f1a97a7688ec12d86508dfb5905dc8f121641099270099acaefc99c1a040be34" gracePeriod=30
Aug 04 00:46:08.031016 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:08.030975    2556 patch_prober.go:28] interesting pod/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 00:46:08.031399 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:08.031039    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq" podUID="3299d13a-1a43-47d9-bd9e-8aa9891c9305" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 00:46:10.108073 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.107992    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:46:10.141042 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.141007    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istio-data\") pod \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") "
Aug 04 00:46:10.141258 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.141067    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-workload-certs\") pod \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") "
Aug 04 00:46:10.141258 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.141099    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istio-envoy\") pod \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") "
Aug 04 00:46:10.141258 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.141124    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-workload-socket\") pod \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") "
Aug 04 00:46:10.141258 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.141151    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istio-podinfo\") pod \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") "
Aug 04 00:46:10.141485 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.141290    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr9f7\" (UniqueName: \"kubernetes.io/projected/3299d13a-1a43-47d9-bd9e-8aa9891c9305-kube-api-access-jr9f7\") pod \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") "
Aug 04 00:46:10.141485 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.141323    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istio-token\") pod \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") "
Aug 04 00:46:10.141485 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.141359    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istiod-ca-cert\") pod \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") "
Aug 04 00:46:10.141485 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.141374    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istio-data" (OuterVolumeSpecName: "istio-data") pod "3299d13a-1a43-47d9-bd9e-8aa9891c9305" (UID: "3299d13a-1a43-47d9-bd9e-8aa9891c9305"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:46:10.141485 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.141393    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-credential-socket\") pod \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\" (UID: \"3299d13a-1a43-47d9-bd9e-8aa9891c9305\") "
Aug 04 00:46:10.141485 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.141403    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3299d13a-1a43-47d9-bd9e-8aa9891c9305" (UID: "3299d13a-1a43-47d9-bd9e-8aa9891c9305"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:46:10.141793 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.141750    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istio-data\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:46:10.141793 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.141755    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3299d13a-1a43-47d9-bd9e-8aa9891c9305" (UID: "3299d13a-1a43-47d9-bd9e-8aa9891c9305"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:46:10.141793 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.141768    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-workload-certs\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:46:10.141955 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.141910    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3299d13a-1a43-47d9-bd9e-8aa9891c9305" (UID: "3299d13a-1a43-47d9-bd9e-8aa9891c9305"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:46:10.141955 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.141925    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3299d13a-1a43-47d9-bd9e-8aa9891c9305" (UID: "3299d13a-1a43-47d9-bd9e-8aa9891c9305"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:46:10.143728 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.143664    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istio-token" (OuterVolumeSpecName: "istio-token") pod "3299d13a-1a43-47d9-bd9e-8aa9891c9305" (UID: "3299d13a-1a43-47d9-bd9e-8aa9891c9305"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:46:10.144065 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.144040    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3299d13a-1a43-47d9-bd9e-8aa9891c9305" (UID: "3299d13a-1a43-47d9-bd9e-8aa9891c9305"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 00:46:10.144065 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.144055    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3299d13a-1a43-47d9-bd9e-8aa9891c9305" (UID: "3299d13a-1a43-47d9-bd9e-8aa9891c9305"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:46:10.144183 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.144053    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3299d13a-1a43-47d9-bd9e-8aa9891c9305-kube-api-access-jr9f7" (OuterVolumeSpecName: "kube-api-access-jr9f7") pod "3299d13a-1a43-47d9-bd9e-8aa9891c9305" (UID: "3299d13a-1a43-47d9-bd9e-8aa9891c9305"). InnerVolumeSpecName "kube-api-access-jr9f7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:46:10.243070 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.243013    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr9f7\" (UniqueName: \"kubernetes.io/projected/3299d13a-1a43-47d9-bd9e-8aa9891c9305-kube-api-access-jr9f7\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:46:10.243070 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.243065    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istio-token\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:46:10.243070 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.243078    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istiod-ca-cert\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:46:10.243332 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.243090    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-credential-socket\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:46:10.243332 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.243102    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istio-envoy\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:46:10.243332 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.243114    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3299d13a-1a43-47d9-bd9e-8aa9891c9305-workload-socket\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:46:10.243332 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.243125    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3299d13a-1a43-47d9-bd9e-8aa9891c9305-istio-podinfo\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:46:10.367331 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.367227    2556 generic.go:356] "Generic (PLEG): container finished" podID="3299d13a-1a43-47d9-bd9e-8aa9891c9305" containerID="f1a97a7688ec12d86508dfb5905dc8f121641099270099acaefc99c1a040be34" exitCode=0
Aug 04 00:46:10.367331 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.367286    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"
Aug 04 00:46:10.367331 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.367296    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq" event={"ID":"3299d13a-1a43-47d9-bd9e-8aa9891c9305","Type":"ContainerDied","Data":"f1a97a7688ec12d86508dfb5905dc8f121641099270099acaefc99c1a040be34"}
Aug 04 00:46:10.367560 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.367354    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq" event={"ID":"3299d13a-1a43-47d9-bd9e-8aa9891c9305","Type":"ContainerDied","Data":"03a2a03ff0e2544d6c2d70e0f3cd9dca1b7a7e8360eab3dddbafccaa5f58c6c7"}
Aug 04 00:46:10.367560 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.367385    2556 scope.go:117] "RemoveContainer" containerID="f1a97a7688ec12d86508dfb5905dc8f121641099270099acaefc99c1a040be34"
Aug 04 00:46:10.376697 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.376674    2556 scope.go:117] "RemoveContainer" containerID="e1f840fec0b77303be7c22d726b44cfc8d08051ff6ffb78f6d29a3d045b02dce"
Aug 04 00:46:10.384794 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.384762    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"]
Aug 04 00:46:10.387114 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.387089    2556 scope.go:117] "RemoveContainer" containerID="f1a97a7688ec12d86508dfb5905dc8f121641099270099acaefc99c1a040be34"
Aug 04 00:46:10.387962 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:46:10.387447    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1a97a7688ec12d86508dfb5905dc8f121641099270099acaefc99c1a040be34\": container with ID starting with f1a97a7688ec12d86508dfb5905dc8f121641099270099acaefc99c1a040be34 not found: ID does not exist" containerID="f1a97a7688ec12d86508dfb5905dc8f121641099270099acaefc99c1a040be34"
Aug 04 00:46:10.387962 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.387874    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1a97a7688ec12d86508dfb5905dc8f121641099270099acaefc99c1a040be34"} err="failed to get container status \"f1a97a7688ec12d86508dfb5905dc8f121641099270099acaefc99c1a040be34\": rpc error: code = NotFound desc = could not find container \"f1a97a7688ec12d86508dfb5905dc8f121641099270099acaefc99c1a040be34\": container with ID starting with f1a97a7688ec12d86508dfb5905dc8f121641099270099acaefc99c1a040be34 not found: ID does not exist"
Aug 04 00:46:10.387962 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.387907    2556 scope.go:117] "RemoveContainer" containerID="e1f840fec0b77303be7c22d726b44cfc8d08051ff6ffb78f6d29a3d045b02dce"
Aug 04 00:46:10.388565 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:46:10.388529    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1f840fec0b77303be7c22d726b44cfc8d08051ff6ffb78f6d29a3d045b02dce\": container with ID starting with e1f840fec0b77303be7c22d726b44cfc8d08051ff6ffb78f6d29a3d045b02dce not found: ID does not exist" containerID="e1f840fec0b77303be7c22d726b44cfc8d08051ff6ffb78f6d29a3d045b02dce"
Aug 04 00:46:10.388694 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.388576    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1f840fec0b77303be7c22d726b44cfc8d08051ff6ffb78f6d29a3d045b02dce"} err="failed to get container status \"e1f840fec0b77303be7c22d726b44cfc8d08051ff6ffb78f6d29a3d045b02dce\": rpc error: code = NotFound desc = could not find container \"e1f840fec0b77303be7c22d726b44cfc8d08051ff6ffb78f6d29a3d045b02dce\": container with ID starting with e1f840fec0b77303be7c22d726b44cfc8d08051ff6ffb78f6d29a3d045b02dce not found: ID does not exist"
Aug 04 00:46:10.389258 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:10.389218    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-b26f4b-openshift-default-dc8f89c96-jjdwq"]
Aug 04 00:46:12.307395 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:12.307360    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3299d13a-1a43-47d9-bd9e-8aa9891c9305" path="/var/lib/kubelet/pods/3299d13a-1a43-47d9-bd9e-8aa9891c9305/volumes"
Aug 04 00:46:27.213540 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:27.213498    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"]
Aug 04 00:46:27.213989 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:27.213843    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs" podUID="d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" containerName="istio-proxy" containerID="cri-o://db333b52549a5d976be0d1082e3ac88d8744dbabbc4b90bb1f06907e55bc341a" gracePeriod=30
Aug 04 00:46:32.476621 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.476547    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:46:32.487370 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.487330    2556 generic.go:356] "Generic (PLEG): container finished" podID="d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" containerID="db333b52549a5d976be0d1082e3ac88d8744dbabbc4b90bb1f06907e55bc341a" exitCode=0
Aug 04 00:46:32.487370 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.487383    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"
Aug 04 00:46:32.487594 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.487417    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs" event={"ID":"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e","Type":"ContainerDied","Data":"db333b52549a5d976be0d1082e3ac88d8744dbabbc4b90bb1f06907e55bc341a"}
Aug 04 00:46:32.487594 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.487480    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs" event={"ID":"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e","Type":"ContainerDied","Data":"3fee9f5a719514a5c2af624018536e9ccdce3bba195f840506889d9697148562"}
Aug 04 00:46:32.487594 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.487505    2556 scope.go:117] "RemoveContainer" containerID="db333b52549a5d976be0d1082e3ac88d8744dbabbc4b90bb1f06907e55bc341a"
Aug 04 00:46:32.496812 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.496782    2556 scope.go:117] "RemoveContainer" containerID="c817f8d6ecf8d4a3cc7671dc9eda6fc86547c7cbc3763b6e4ec9477cb3c26baa"
Aug 04 00:46:32.508054 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.508026    2556 scope.go:117] "RemoveContainer" containerID="db333b52549a5d976be0d1082e3ac88d8744dbabbc4b90bb1f06907e55bc341a"
Aug 04 00:46:32.508455 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:46:32.508430    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db333b52549a5d976be0d1082e3ac88d8744dbabbc4b90bb1f06907e55bc341a\": container with ID starting with db333b52549a5d976be0d1082e3ac88d8744dbabbc4b90bb1f06907e55bc341a not found: ID does not exist" containerID="db333b52549a5d976be0d1082e3ac88d8744dbabbc4b90bb1f06907e55bc341a"
Aug 04 00:46:32.508534 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.508468    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db333b52549a5d976be0d1082e3ac88d8744dbabbc4b90bb1f06907e55bc341a"} err="failed to get container status \"db333b52549a5d976be0d1082e3ac88d8744dbabbc4b90bb1f06907e55bc341a\": rpc error: code = NotFound desc = could not find container \"db333b52549a5d976be0d1082e3ac88d8744dbabbc4b90bb1f06907e55bc341a\": container with ID starting with db333b52549a5d976be0d1082e3ac88d8744dbabbc4b90bb1f06907e55bc341a not found: ID does not exist"
Aug 04 00:46:32.508534 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.508494    2556 scope.go:117] "RemoveContainer" containerID="c817f8d6ecf8d4a3cc7671dc9eda6fc86547c7cbc3763b6e4ec9477cb3c26baa"
Aug 04 00:46:32.508813 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:46:32.508791    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c817f8d6ecf8d4a3cc7671dc9eda6fc86547c7cbc3763b6e4ec9477cb3c26baa\": container with ID starting with c817f8d6ecf8d4a3cc7671dc9eda6fc86547c7cbc3763b6e4ec9477cb3c26baa not found: ID does not exist" containerID="c817f8d6ecf8d4a3cc7671dc9eda6fc86547c7cbc3763b6e4ec9477cb3c26baa"
Aug 04 00:46:32.508909 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.508817    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c817f8d6ecf8d4a3cc7671dc9eda6fc86547c7cbc3763b6e4ec9477cb3c26baa"} err="failed to get container status \"c817f8d6ecf8d4a3cc7671dc9eda6fc86547c7cbc3763b6e4ec9477cb3c26baa\": rpc error: code = NotFound desc = could not find container \"c817f8d6ecf8d4a3cc7671dc9eda6fc86547c7cbc3763b6e4ec9477cb3c26baa\": container with ID starting with c817f8d6ecf8d4a3cc7671dc9eda6fc86547c7cbc3763b6e4ec9477cb3c26baa not found: ID does not exist"
Aug 04 00:46:32.563842 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.563804    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istio-podinfo\") pod \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") "
Aug 04 00:46:32.564010 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.563854    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istiod-ca-cert\") pod \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") "
Aug 04 00:46:32.564010 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.563878    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-credential-socket\") pod \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") "
Aug 04 00:46:32.564010 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.563917    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-workload-certs\") pod \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") "
Aug 04 00:46:32.564010 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.563949    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-workload-socket\") pod \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") "
Aug 04 00:46:32.564010 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.563984    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istio-envoy\") pod \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") "
Aug 04 00:46:32.564273 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.564014    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istio-data\") pod \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") "
Aug 04 00:46:32.564273 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.564067    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lxkn\" (UniqueName: \"kubernetes.io/projected/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-kube-api-access-9lxkn\") pod \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") "
Aug 04 00:46:32.564273 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.564117    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istio-token\") pod \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\" (UID: \"d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e\") "
Aug 04 00:46:32.564273 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.564225    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" (UID: "d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:46:32.564273 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.564245    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" (UID: "d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:46:32.564273 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.564232    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" (UID: "d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:46:32.564273 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.564267    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" (UID: "d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:46:32.564639 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.564482    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-workload-socket\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:46:32.564639 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.564504    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istiod-ca-cert\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:46:32.564735 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.564653    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-credential-socket\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:46:32.564735 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.564668    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-workload-certs\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:46:32.564735 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.564601    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istio-data" (OuterVolumeSpecName: "istio-data") pod "d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" (UID: "d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:46:32.566335 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.566301    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istio-token" (OuterVolumeSpecName: "istio-token") pod "d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" (UID: "d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:46:32.566335 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.566320    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-kube-api-access-9lxkn" (OuterVolumeSpecName: "kube-api-access-9lxkn") pod "d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" (UID: "d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e"). InnerVolumeSpecName "kube-api-access-9lxkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:46:32.566621 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.566594    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" (UID: "d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 00:46:32.566775 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.566594    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" (UID: "d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:46:32.665313 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.665282    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istio-podinfo\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:46:32.665313 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.665309    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istio-envoy\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:46:32.665313 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.665318    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istio-data\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:46:32.665550 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.665326    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lxkn\" (UniqueName: \"kubernetes.io/projected/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-kube-api-access-9lxkn\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:46:32.665550 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.665336    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e-istio-token\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:46:32.808903 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.808857    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"]
Aug 04 00:46:32.814438 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:32.814409    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-907df3-openshift-default-5c89c79dfb-hmnhs"]
Aug 04 00:46:34.307886 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:34.307853    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" path="/var/lib/kubelet/pods/d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e/volumes"
Aug 04 00:46:56.203238 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.203196    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"]
Aug 04 00:46:56.203742 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.203615    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" containerName="istio-proxy"
Aug 04 00:46:56.203742 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.203631    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" containerName="istio-proxy"
Aug 04 00:46:56.203742 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.203651    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc33db69-85b8-48b6-9a0e-8109e5d87b3d" containerName="revoke-keys"
Aug 04 00:46:56.203742 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.203658    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc33db69-85b8-48b6-9a0e-8109e5d87b3d" containerName="revoke-keys"
Aug 04 00:46:56.203742 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.203673    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3299d13a-1a43-47d9-bd9e-8aa9891c9305" containerName="istio-proxy"
Aug 04 00:46:56.203742 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.203679    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3299d13a-1a43-47d9-bd9e-8aa9891c9305" containerName="istio-proxy"
Aug 04 00:46:56.203742 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.203689    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3299d13a-1a43-47d9-bd9e-8aa9891c9305" containerName="istio-proxy"
Aug 04 00:46:56.203742 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.203697    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3299d13a-1a43-47d9-bd9e-8aa9891c9305" containerName="istio-proxy"
Aug 04 00:46:56.204021 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.203823    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3299d13a-1a43-47d9-bd9e-8aa9891c9305" containerName="istio-proxy"
Aug 04 00:46:56.204021 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.203833    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" containerName="istio-proxy"
Aug 04 00:46:56.204021 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.203839    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc33db69-85b8-48b6-9a0e-8109e5d87b3d" containerName="revoke-keys"
Aug 04 00:46:56.204021 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.203849    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3299d13a-1a43-47d9-bd9e-8aa9891c9305" containerName="istio-proxy"
Aug 04 00:46:56.207477 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.207452    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.210185 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.210165    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-5396f3-openshift-default-dockercfg-b275x\""
Aug 04 00:46:56.219946 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.219916    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"]
Aug 04 00:46:56.294877 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.294840    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-istio-data\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.295076 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.294948    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psvbb\" (UniqueName: \"kubernetes.io/projected/987130cc-be19-4a0b-9f07-6c062c4a1d84-kube-api-access-psvbb\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.295076 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.294975    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/987130cc-be19-4a0b-9f07-6c062c4a1d84-istiod-ca-cert\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.295076 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.294997    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/987130cc-be19-4a0b-9f07-6c062c4a1d84-istio-podinfo\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.295076 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.295053    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-credential-socket\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.295219 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.295092    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-workload-certs\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.295219 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.295182    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/987130cc-be19-4a0b-9f07-6c062c4a1d84-istio-token\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.295284 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.295241    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-istio-envoy\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.295284 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.295276    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-workload-socket\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.396101 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.396057    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/987130cc-be19-4a0b-9f07-6c062c4a1d84-istio-token\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.396101 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.396102    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-istio-envoy\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.396345 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.396127    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-workload-socket\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.396345 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.396167    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-istio-data\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.396345 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.396246    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psvbb\" (UniqueName: \"kubernetes.io/projected/987130cc-be19-4a0b-9f07-6c062c4a1d84-kube-api-access-psvbb\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.396345 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.396269    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/987130cc-be19-4a0b-9f07-6c062c4a1d84-istiod-ca-cert\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.396345 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.396295    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/987130cc-be19-4a0b-9f07-6c062c4a1d84-istio-podinfo\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.396609 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.396505    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-credential-socket\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.396609 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.396577    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-workload-certs\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.396761 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.396633    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-workload-socket\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.396761 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.396652    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-istio-data\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.396883 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.396868    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-credential-socket\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.396971 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.396951    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-workload-certs\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.397158 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.397135    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/987130cc-be19-4a0b-9f07-6c062c4a1d84-istiod-ca-cert\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.399027 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.399004    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-istio-envoy\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.399284 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.399266    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/987130cc-be19-4a0b-9f07-6c062c4a1d84-istio-podinfo\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.403926 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.403900    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/987130cc-be19-4a0b-9f07-6c062c4a1d84-istio-token\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.404062 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.404044    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psvbb\" (UniqueName: \"kubernetes.io/projected/987130cc-be19-4a0b-9f07-6c062c4a1d84-kube-api-access-psvbb\") pod \"e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") " pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.519578 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.519529    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:56.663787 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.663758    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"]
Aug 04 00:46:56.666289 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:46:56.666251    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod987130cc_be19_4a0b_9f07_6c062c4a1d84.slice/crio-82a2bb81725b70fb19080e9139f0be34e51d903b7f1069c0357ce0ea1cb0583a WatchSource:0}: Error finding container 82a2bb81725b70fb19080e9139f0be34e51d903b7f1069c0357ce0ea1cb0583a: Status 404 returned error can't find the container with id 82a2bb81725b70fb19080e9139f0be34e51d903b7f1069c0357ce0ea1cb0583a
Aug 04 00:46:56.668472 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.668439    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:46:56.668595 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.668512    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:46:56.668595 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:56.668541    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:46:57.627037 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:57.627001    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv" event={"ID":"987130cc-be19-4a0b-9f07-6c062c4a1d84","Type":"ContainerStarted","Data":"d05587a41f5db00d91876c2abead75b11e6b0e06ff810aaf132b374d6ad50d42"}
Aug 04 00:46:57.627433 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:57.627053    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv" event={"ID":"987130cc-be19-4a0b-9f07-6c062c4a1d84","Type":"ContainerStarted","Data":"82a2bb81725b70fb19080e9139f0be34e51d903b7f1069c0357ce0ea1cb0583a"}
Aug 04 00:46:57.649653 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:57.649595    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv" podStartSLOduration=1.649577647 podStartE2EDuration="1.649577647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:46:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:46:57.648252724 +0000 UTC m=+2671.816890097" watchObservedRunningTime="2026-08-04 00:46:57.649577647 +0000 UTC m=+2671.818215016"
Aug 04 00:46:58.520063 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:58.520020    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:58.525795 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:58.525762    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:58.632524 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:58.632490    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:46:58.633498 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:46:58.633476    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:47:12.715515 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:47:12.715410    2556 generic.go:356] "Generic (PLEG): container finished" podID="987130cc-be19-4a0b-9f07-6c062c4a1d84" containerID="d05587a41f5db00d91876c2abead75b11e6b0e06ff810aaf132b374d6ad50d42" exitCode=0
Aug 04 00:47:12.715515 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:47:12.715486    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv" event={"ID":"987130cc-be19-4a0b-9f07-6c062c4a1d84","Type":"ContainerDied","Data":"d05587a41f5db00d91876c2abead75b11e6b0e06ff810aaf132b374d6ad50d42"}
Aug 04 00:47:12.715995 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:47:12.715919    2556 scope.go:117] "RemoveContainer" containerID="d05587a41f5db00d91876c2abead75b11e6b0e06ff810aaf132b374d6ad50d42"
Aug 04 00:47:12.716973 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:47:12.716944    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:47:12.717057 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:47:12.717014    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:47:12.717057 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:47:12.717046    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:47:13.632418 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:47:13.632382    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:47:13.722992 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:47:13.722948    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv" event={"ID":"987130cc-be19-4a0b-9f07-6c062c4a1d84","Type":"ContainerStarted","Data":"a9a0d4f42450d42246603de9c33c941a5f1f189018da24060e5ffc4cf5f61a35"}
Aug 04 00:47:14.519916 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:47:14.519875    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:47:14.520945 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:47:14.520916    2556 patch_prober.go:28] interesting pod/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Aug 04 00:47:14.521084 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:47:14.520966    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv" podUID="987130cc-be19-4a0b-9f07-6c062c4a1d84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Aug 04 00:47:15.520474 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:47:15.520438    2556 patch_prober.go:28] interesting pod/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Aug 04 00:47:15.520919 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:47:15.520494    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv" podUID="987130cc-be19-4a0b-9f07-6c062c4a1d84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Aug 04 00:47:16.520368 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:47:16.520334    2556 patch_prober.go:28] interesting pod/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Aug 04 00:47:16.520555 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:47:16.520389    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv" podUID="987130cc-be19-4a0b-9f07-6c062c4a1d84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Aug 04 00:47:17.520623 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:47:17.520578    2556 patch_prober.go:28] interesting pod/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Aug 04 00:47:17.521077 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:47:17.520637    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv" podUID="987130cc-be19-4a0b-9f07-6c062c4a1d84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Aug 04 00:47:18.520279 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:47:18.520184    2556 patch_prober.go:28] interesting pod/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Aug 04 00:47:18.520279 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:47:18.520244    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv" podUID="987130cc-be19-4a0b-9f07-6c062c4a1d84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Aug 04 00:47:19.523682 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:47:19.523652    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:47:19.524127 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:47:19.523937    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:47:19.524738 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:47:19.524691    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 00:47:26.448561 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:47:26.448521    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:47:26.458772 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:47:26.458748    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:48:06.404789 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.404752    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"]
Aug 04 00:48:06.405418 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.405368    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" containerName="istio-proxy"
Aug 04 00:48:06.405418 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.405390    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" containerName="istio-proxy"
Aug 04 00:48:06.405567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.405487    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8a36c84-2d8c-43eb-94c5-6f0e0cfd886e" containerName="istio-proxy"
Aug 04 00:48:06.408478 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.408453    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:48:06.411002 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.410960    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a5b2e0\"/\"openshift-service-ca.crt\""
Aug 04 00:48:06.411172 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.411054    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a5b2e0\"/\"auth-test-model-a5b2e0-kserve-self-signed-certs\""
Aug 04 00:48:06.411850 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.411827    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a5b2e0\"/\"kube-root-ca.crt\""
Aug 04 00:48:06.411958 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.411856    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a5b2e0\"/\"default-dockercfg-ksf82\""
Aug 04 00:48:06.418947 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.418917    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"]
Aug 04 00:48:06.479675 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.479639    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8hsm\" (UniqueName: \"kubernetes.io/projected/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-kube-api-access-k8hsm\") pod \"auth-test-model-a5b2e0-kserve-86c764857f-8hgzp\" (UID: \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\") " pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:48:06.479887 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.479690    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-dshm\") pod \"auth-test-model-a5b2e0-kserve-86c764857f-8hgzp\" (UID: \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\") " pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:48:06.479887 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.479770    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-tmp-dir\") pod \"auth-test-model-a5b2e0-kserve-86c764857f-8hgzp\" (UID: \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\") " pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:48:06.479887 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.479795    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-model-cache\") pod \"auth-test-model-a5b2e0-kserve-86c764857f-8hgzp\" (UID: \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\") " pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:48:06.480046 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.479880    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-home\") pod \"auth-test-model-a5b2e0-kserve-86c764857f-8hgzp\" (UID: \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\") " pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:48:06.480046 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.479920    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-tls-certs\") pod \"auth-test-model-a5b2e0-kserve-86c764857f-8hgzp\" (UID: \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\") " pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:48:06.581204 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.581160    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-tmp-dir\") pod \"auth-test-model-a5b2e0-kserve-86c764857f-8hgzp\" (UID: \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\") " pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:48:06.581204 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.581211    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-model-cache\") pod \"auth-test-model-a5b2e0-kserve-86c764857f-8hgzp\" (UID: \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\") " pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:48:06.581477 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.581248    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-home\") pod \"auth-test-model-a5b2e0-kserve-86c764857f-8hgzp\" (UID: \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\") " pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:48:06.581477 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.581264    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-tls-certs\") pod \"auth-test-model-a5b2e0-kserve-86c764857f-8hgzp\" (UID: \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\") " pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:48:06.581477 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.581300    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8hsm\" (UniqueName: \"kubernetes.io/projected/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-kube-api-access-k8hsm\") pod \"auth-test-model-a5b2e0-kserve-86c764857f-8hgzp\" (UID: \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\") " pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:48:06.581477 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.581386    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-dshm\") pod \"auth-test-model-a5b2e0-kserve-86c764857f-8hgzp\" (UID: \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\") " pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:48:06.581704 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.581614    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-tmp-dir\") pod \"auth-test-model-a5b2e0-kserve-86c764857f-8hgzp\" (UID: \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\") " pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:48:06.581704 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.581688    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-home\") pod \"auth-test-model-a5b2e0-kserve-86c764857f-8hgzp\" (UID: \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\") " pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:48:06.581832 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.581745    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-model-cache\") pod \"auth-test-model-a5b2e0-kserve-86c764857f-8hgzp\" (UID: \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\") " pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:48:06.583634 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.583613    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-dshm\") pod \"auth-test-model-a5b2e0-kserve-86c764857f-8hgzp\" (UID: \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\") " pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:48:06.583826 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.583807    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-tls-certs\") pod \"auth-test-model-a5b2e0-kserve-86c764857f-8hgzp\" (UID: \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\") " pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:48:06.589151 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.589124    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8hsm\" (UniqueName: \"kubernetes.io/projected/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-kube-api-access-k8hsm\") pod \"auth-test-model-a5b2e0-kserve-86c764857f-8hgzp\" (UID: \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\") " pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:48:06.719887 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.719776    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:48:06.857694 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:06.857666    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"]
Aug 04 00:48:06.860080 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:48:06.860050    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc9f1dfe_6d8c_4d60_a74b_db3ea115bd40.slice/crio-42d523889ae6801317bfcc70daaa16f859982213520f7ebbf274204ae14cb16a WatchSource:0}: Error finding container 42d523889ae6801317bfcc70daaa16f859982213520f7ebbf274204ae14cb16a: Status 404 returned error can't find the container with id 42d523889ae6801317bfcc70daaa16f859982213520f7ebbf274204ae14cb16a
Aug 04 00:48:07.013997 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:07.013957    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp" event={"ID":"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40","Type":"ContainerStarted","Data":"a1b2bc2add0f4aa9a993855c7b7972e981eb8256acf5f68ded30aef856623421"}
Aug 04 00:48:07.013997 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:07.014005    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp" event={"ID":"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40","Type":"ContainerStarted","Data":"42d523889ae6801317bfcc70daaa16f859982213520f7ebbf274204ae14cb16a"}
Aug 04 00:48:07.031325 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:07.031260    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp" podStartSLOduration=1.031240182 podStartE2EDuration="1.031240182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:48:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:48:07.028069594 +0000 UTC m=+2741.196706964" watchObservedRunningTime="2026-08-04 00:48:07.031240182 +0000 UTC m=+2741.199877552"
Aug 04 00:48:16.720396 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:16.720349    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:48:16.721002 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:16.720421    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:48:16.732913 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:16.732884    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:48:17.074631 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:17.074599    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:48:53.805438 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:53.805358    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"]
Aug 04 00:48:53.809049 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:53.809028    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:48:53.812414 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:53.812379    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5396f3\"/\"auth-test-model-5396f3-kserve-self-signed-certs\""
Aug 04 00:48:53.812558 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:53.812427    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5396f3\"/\"kube-root-ca.crt\""
Aug 04 00:48:53.812558 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:53.812390    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5396f3\"/\"default-dockercfg-tw28l\""
Aug 04 00:48:53.812558 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:53.812390    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5396f3\"/\"openshift-service-ca.crt\""
Aug 04 00:48:53.817117 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:53.817094    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"]
Aug 04 00:48:53.956202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:53.956158    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-tls-certs\") pod \"auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq\" (UID: \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\") " pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:48:53.956202 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:53.956200    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-home\") pod \"auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq\" (UID: \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\") " pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:48:53.956446 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:53.956338    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-dshm\") pod \"auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq\" (UID: \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\") " pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:48:53.956446 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:53.956396    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-model-cache\") pod \"auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq\" (UID: \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\") " pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:48:53.956522 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:53.956465    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgpsc\" (UniqueName: \"kubernetes.io/projected/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-kube-api-access-xgpsc\") pod \"auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq\" (UID: \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\") " pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:48:53.956522 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:53.956499    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-tmp-dir\") pod \"auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq\" (UID: \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\") " pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:48:54.058030 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:54.057922    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgpsc\" (UniqueName: \"kubernetes.io/projected/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-kube-api-access-xgpsc\") pod \"auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq\" (UID: \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\") " pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:48:54.058030 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:54.057979    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-tmp-dir\") pod \"auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq\" (UID: \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\") " pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:48:54.058030 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:54.058027    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-tls-certs\") pod \"auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq\" (UID: \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\") " pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:48:54.058341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:54.058051    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-home\") pod \"auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq\" (UID: \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\") " pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:48:54.058341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:54.058197    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-dshm\") pod \"auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq\" (UID: \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\") " pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:48:54.058341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:54.058256    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-model-cache\") pod \"auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq\" (UID: \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\") " pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:48:54.058530 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:54.058509    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-home\") pod \"auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq\" (UID: \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\") " pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:48:54.058585 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:54.058565    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-tmp-dir\") pod \"auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq\" (UID: \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\") " pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:48:54.058626 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:54.058593    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-model-cache\") pod \"auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq\" (UID: \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\") " pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:48:54.060419 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:54.060396    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-dshm\") pod \"auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq\" (UID: \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\") " pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:48:54.060668 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:54.060651    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-tls-certs\") pod \"auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq\" (UID: \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\") " pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:48:54.066958 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:54.066931    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgpsc\" (UniqueName: \"kubernetes.io/projected/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-kube-api-access-xgpsc\") pod \"auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq\" (UID: \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\") " pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:48:54.121161 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:54.121117    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:48:54.266594 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:54.266534    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"]
Aug 04 00:48:54.269092 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:48:54.269059    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54cd5295_c722_4edd_b4e4_1f01fa52ae9d.slice/crio-a62a96f725e364cc6d87bcb58e1b8af298337a9940e49a507252120860d7128f WatchSource:0}: Error finding container a62a96f725e364cc6d87bcb58e1b8af298337a9940e49a507252120860d7128f: Status 404 returned error can't find the container with id a62a96f725e364cc6d87bcb58e1b8af298337a9940e49a507252120860d7128f
Aug 04 00:48:55.269631 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:55.269583    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq" event={"ID":"54cd5295-c722-4edd-b4e4-1f01fa52ae9d","Type":"ContainerStarted","Data":"759de760deccd5facc6f5f7f4b483a13ae6cf5756d0be4a981abc712a50ce56b"}
Aug 04 00:48:55.269631 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:55.269639    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq" event={"ID":"54cd5295-c722-4edd-b4e4-1f01fa52ae9d","Type":"ContainerStarted","Data":"a62a96f725e364cc6d87bcb58e1b8af298337a9940e49a507252120860d7128f"}
Aug 04 00:48:55.288532 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:48:55.288474    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq" podStartSLOduration=2.288456164 podStartE2EDuration="2.288456164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:48:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:48:55.287600316 +0000 UTC m=+2789.456237687" watchObservedRunningTime="2026-08-04 00:48:55.288456164 +0000 UTC m=+2789.457093534"
Aug 04 00:49:04.121302 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:49:04.121264    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:49:04.121699 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:49:04.121317    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:49:04.133870 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:49:04.133843    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:49:04.328510 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:49:04.328482    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:51:26.674788 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:51:26.674753    2556 scope.go:117] "RemoveContainer" containerID="61fcca1b138befe4e2971e35facdeb9170a8bff15eeb3d07b494134645d6f395"
Aug 04 00:51:52.491371 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:51:52.491288    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"]
Aug 04 00:51:53.394737 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:51:53.394689    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"]
Aug 04 00:52:07.510585 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:07.510518    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp" podUID="fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40" containerName="main" containerID="cri-o://a1b2bc2add0f4aa9a993855c7b7972e981eb8256acf5f68ded30aef856623421" gracePeriod=45
Aug 04 00:52:07.770369 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:07.770296    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:52:07.934087 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:07.934040    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-model-cache\") pod \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\" (UID: \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\") "
Aug 04 00:52:07.934310 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:07.934155    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-home\") pod \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\" (UID: \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\") "
Aug 04 00:52:07.934310 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:07.934218    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-tls-certs\") pod \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\" (UID: \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\") "
Aug 04 00:52:07.934310 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:07.934281    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8hsm\" (UniqueName: \"kubernetes.io/projected/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-kube-api-access-k8hsm\") pod \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\" (UID: \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\") "
Aug 04 00:52:07.934310 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:07.934291    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-model-cache" (OuterVolumeSpecName: "model-cache") pod "fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40" (UID: "fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:52:07.934550 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:07.934322    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-home" (OuterVolumeSpecName: "home") pod "fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40" (UID: "fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:52:07.934550 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:07.934354    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-tmp-dir\") pod \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\" (UID: \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\") "
Aug 04 00:52:07.934550 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:07.934397    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-dshm\") pod \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\" (UID: \"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40\") "
Aug 04 00:52:07.934550 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:07.934493    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40" (UID: "fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:52:07.934760 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:07.934742    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-tmp-dir\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:52:07.934828 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:07.934761    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-model-cache\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:52:07.934828 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:07.934770    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-home\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:52:07.936518 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:07.936486    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40" (UID: "fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:52:07.936518 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:07.936486    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-dshm" (OuterVolumeSpecName: "dshm") pod "fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40" (UID: "fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:52:07.936670 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:07.936594    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-kube-api-access-k8hsm" (OuterVolumeSpecName: "kube-api-access-k8hsm") pod "fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40" (UID: "fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40"). InnerVolumeSpecName "kube-api-access-k8hsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:52:08.036303 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.036203    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-tls-certs\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:52:08.036303 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.036237    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8hsm\" (UniqueName: \"kubernetes.io/projected/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-kube-api-access-k8hsm\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:52:08.036303 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.036251    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40-dshm\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:52:08.301072 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.300972    2556 generic.go:356] "Generic (PLEG): container finished" podID="fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40" containerID="a1b2bc2add0f4aa9a993855c7b7972e981eb8256acf5f68ded30aef856623421" exitCode=0
Aug 04 00:52:08.301259 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.301080    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"
Aug 04 00:52:08.307589 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.307554    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp" event={"ID":"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40","Type":"ContainerDied","Data":"a1b2bc2add0f4aa9a993855c7b7972e981eb8256acf5f68ded30aef856623421"}
Aug 04 00:52:08.307589 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.307600    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp" event={"ID":"fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40","Type":"ContainerDied","Data":"42d523889ae6801317bfcc70daaa16f859982213520f7ebbf274204ae14cb16a"}
Aug 04 00:52:08.307900 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.307626    2556 scope.go:117] "RemoveContainer" containerID="a1b2bc2add0f4aa9a993855c7b7972e981eb8256acf5f68ded30aef856623421"
Aug 04 00:52:08.316670 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.316652    2556 scope.go:117] "RemoveContainer" containerID="a1b2bc2add0f4aa9a993855c7b7972e981eb8256acf5f68ded30aef856623421"
Aug 04 00:52:08.316958 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:52:08.316939    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1b2bc2add0f4aa9a993855c7b7972e981eb8256acf5f68ded30aef856623421\": container with ID starting with a1b2bc2add0f4aa9a993855c7b7972e981eb8256acf5f68ded30aef856623421 not found: ID does not exist" containerID="a1b2bc2add0f4aa9a993855c7b7972e981eb8256acf5f68ded30aef856623421"
Aug 04 00:52:08.317016 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.316967    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1b2bc2add0f4aa9a993855c7b7972e981eb8256acf5f68ded30aef856623421"} err="failed to get container status \"a1b2bc2add0f4aa9a993855c7b7972e981eb8256acf5f68ded30aef856623421\": rpc error: code = NotFound desc = could not find container \"a1b2bc2add0f4aa9a993855c7b7972e981eb8256acf5f68ded30aef856623421\": container with ID starting with a1b2bc2add0f4aa9a993855c7b7972e981eb8256acf5f68ded30aef856623421 not found: ID does not exist"
Aug 04 00:52:08.324881 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.324852    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"]
Aug 04 00:52:08.327566 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.327542    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a5b2e0/auth-test-model-a5b2e0-kserve-86c764857f-8hgzp"]
Aug 04 00:52:08.414083 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.414044    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq" podUID="54cd5295-c722-4edd-b4e4-1f01fa52ae9d" containerName="main" containerID="cri-o://759de760deccd5facc6f5f7f4b483a13ae6cf5756d0be4a981abc712a50ce56b" gracePeriod=45
Aug 04 00:52:08.661899 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.661873    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:52:08.741363 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.741333    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-model-cache\") pod \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\" (UID: \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\") "
Aug 04 00:52:08.741363 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.741368    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-tmp-dir\") pod \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\" (UID: \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\") "
Aug 04 00:52:08.741635 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.741429    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgpsc\" (UniqueName: \"kubernetes.io/projected/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-kube-api-access-xgpsc\") pod \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\" (UID: \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\") "
Aug 04 00:52:08.741635 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.741450    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-tls-certs\") pod \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\" (UID: \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\") "
Aug 04 00:52:08.741635 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.741470    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-home\") pod \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\" (UID: \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\") "
Aug 04 00:52:08.741635 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.741491    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-dshm\") pod \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\" (UID: \"54cd5295-c722-4edd-b4e4-1f01fa52ae9d\") "
Aug 04 00:52:08.741884 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.741663    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-model-cache" (OuterVolumeSpecName: "model-cache") pod "54cd5295-c722-4edd-b4e4-1f01fa52ae9d" (UID: "54cd5295-c722-4edd-b4e4-1f01fa52ae9d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:52:08.741884 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.741754    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "54cd5295-c722-4edd-b4e4-1f01fa52ae9d" (UID: "54cd5295-c722-4edd-b4e4-1f01fa52ae9d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:52:08.741884 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.741778    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-home" (OuterVolumeSpecName: "home") pod "54cd5295-c722-4edd-b4e4-1f01fa52ae9d" (UID: "54cd5295-c722-4edd-b4e4-1f01fa52ae9d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:52:08.743822 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.743787    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-dshm" (OuterVolumeSpecName: "dshm") pod "54cd5295-c722-4edd-b4e4-1f01fa52ae9d" (UID: "54cd5295-c722-4edd-b4e4-1f01fa52ae9d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:52:08.743960 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.743861    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-kube-api-access-xgpsc" (OuterVolumeSpecName: "kube-api-access-xgpsc") pod "54cd5295-c722-4edd-b4e4-1f01fa52ae9d" (UID: "54cd5295-c722-4edd-b4e4-1f01fa52ae9d"). InnerVolumeSpecName "kube-api-access-xgpsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:52:08.743960 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.743859    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "54cd5295-c722-4edd-b4e4-1f01fa52ae9d" (UID: "54cd5295-c722-4edd-b4e4-1f01fa52ae9d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:52:08.842515 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.842418    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgpsc\" (UniqueName: \"kubernetes.io/projected/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-kube-api-access-xgpsc\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:52:08.842515 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.842459    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-tls-certs\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:52:08.842515 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.842474    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-home\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:52:08.842515 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.842486    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-dshm\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:52:08.842515 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.842498    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-model-cache\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:52:08.842829 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:08.842517    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54cd5295-c722-4edd-b4e4-1f01fa52ae9d-tmp-dir\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:52:09.307419 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:09.307387    2556 generic.go:356] "Generic (PLEG): container finished" podID="54cd5295-c722-4edd-b4e4-1f01fa52ae9d" containerID="759de760deccd5facc6f5f7f4b483a13ae6cf5756d0be4a981abc712a50ce56b" exitCode=0
Aug 04 00:52:09.307637 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:09.307428    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"
Aug 04 00:52:09.307637 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:09.307470    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq" event={"ID":"54cd5295-c722-4edd-b4e4-1f01fa52ae9d","Type":"ContainerDied","Data":"759de760deccd5facc6f5f7f4b483a13ae6cf5756d0be4a981abc712a50ce56b"}
Aug 04 00:52:09.307637 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:09.307516    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq" event={"ID":"54cd5295-c722-4edd-b4e4-1f01fa52ae9d","Type":"ContainerDied","Data":"a62a96f725e364cc6d87bcb58e1b8af298337a9940e49a507252120860d7128f"}
Aug 04 00:52:09.307637 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:09.307534    2556 scope.go:117] "RemoveContainer" containerID="759de760deccd5facc6f5f7f4b483a13ae6cf5756d0be4a981abc712a50ce56b"
Aug 04 00:52:09.317145 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:09.317125    2556 scope.go:117] "RemoveContainer" containerID="759de760deccd5facc6f5f7f4b483a13ae6cf5756d0be4a981abc712a50ce56b"
Aug 04 00:52:09.317452 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:52:09.317433    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"759de760deccd5facc6f5f7f4b483a13ae6cf5756d0be4a981abc712a50ce56b\": container with ID starting with 759de760deccd5facc6f5f7f4b483a13ae6cf5756d0be4a981abc712a50ce56b not found: ID does not exist" containerID="759de760deccd5facc6f5f7f4b483a13ae6cf5756d0be4a981abc712a50ce56b"
Aug 04 00:52:09.317498 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:09.317465    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"759de760deccd5facc6f5f7f4b483a13ae6cf5756d0be4a981abc712a50ce56b"} err="failed to get container status \"759de760deccd5facc6f5f7f4b483a13ae6cf5756d0be4a981abc712a50ce56b\": rpc error: code = NotFound desc = could not find container \"759de760deccd5facc6f5f7f4b483a13ae6cf5756d0be4a981abc712a50ce56b\": container with ID starting with 759de760deccd5facc6f5f7f4b483a13ae6cf5756d0be4a981abc712a50ce56b not found: ID does not exist"
Aug 04 00:52:09.334102 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:09.334066    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"]
Aug 04 00:52:09.339601 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:09.339566    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-5396f3/auth-test-model-5396f3-kserve-79b6ccd95f-jj5rq"]
Aug 04 00:52:10.308092 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:10.308053    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54cd5295-c722-4edd-b4e4-1f01fa52ae9d" path="/var/lib/kubelet/pods/54cd5295-c722-4edd-b4e4-1f01fa52ae9d/volumes"
Aug 04 00:52:10.308491 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:10.308481    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40" path="/var/lib/kubelet/pods/fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40/volumes"
Aug 04 00:52:14.840195 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.840161    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"]
Aug 04 00:52:14.842675 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.840556    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40" containerName="main"
Aug 04 00:52:14.842675 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.840568    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40" containerName="main"
Aug 04 00:52:14.842675 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.840588    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54cd5295-c722-4edd-b4e4-1f01fa52ae9d" containerName="main"
Aug 04 00:52:14.842675 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.840594    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="54cd5295-c722-4edd-b4e4-1f01fa52ae9d" containerName="main"
Aug 04 00:52:14.842675 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.840661    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc9f1dfe-6d8c-4d60-a74b-db3ea115bd40" containerName="main"
Aug 04 00:52:14.842675 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.840669    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="54cd5295-c722-4edd-b4e4-1f01fa52ae9d" containerName="main"
Aug 04 00:52:14.843792 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.843773    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:52:14.846986 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.846950    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a5b2e0\"/\"default-dockercfg-ksf82\""
Aug 04 00:52:14.847784 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.847764    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a5b2e0\"/\"kube-root-ca.crt\""
Aug 04 00:52:14.847917 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.847902    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a5b2e0\"/\"openshift-service-ca.crt\""
Aug 04 00:52:14.848010 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.847986    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a5b2e0\"/\"sub-test-model-a5b2e0-kserve-self-signed-certs\""
Aug 04 00:52:14.858471 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.858449    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"]
Aug 04 00:52:14.898117 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.898079    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c3a36c3-8585-42fe-92bf-1219524bfae2-tls-certs\") pod \"sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92\" (UID: \"1c3a36c3-8585-42fe-92bf-1219524bfae2\") " pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:52:14.898302 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.898177    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c3a36c3-8585-42fe-92bf-1219524bfae2-home\") pod \"sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92\" (UID: \"1c3a36c3-8585-42fe-92bf-1219524bfae2\") " pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:52:14.898302 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.898233    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c3a36c3-8585-42fe-92bf-1219524bfae2-tmp-dir\") pod \"sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92\" (UID: \"1c3a36c3-8585-42fe-92bf-1219524bfae2\") " pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:52:14.898302 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.898263    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c3a36c3-8585-42fe-92bf-1219524bfae2-model-cache\") pod \"sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92\" (UID: \"1c3a36c3-8585-42fe-92bf-1219524bfae2\") " pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:52:14.898302 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.898279    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c3a36c3-8585-42fe-92bf-1219524bfae2-dshm\") pod \"sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92\" (UID: \"1c3a36c3-8585-42fe-92bf-1219524bfae2\") " pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:52:14.898524 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.898391    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv82t\" (UniqueName: \"kubernetes.io/projected/1c3a36c3-8585-42fe-92bf-1219524bfae2-kube-api-access-mv82t\") pod \"sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92\" (UID: \"1c3a36c3-8585-42fe-92bf-1219524bfae2\") " pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:52:14.999659 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.999628    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c3a36c3-8585-42fe-92bf-1219524bfae2-home\") pod \"sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92\" (UID: \"1c3a36c3-8585-42fe-92bf-1219524bfae2\") " pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:52:14.999874 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.999688    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c3a36c3-8585-42fe-92bf-1219524bfae2-tmp-dir\") pod \"sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92\" (UID: \"1c3a36c3-8585-42fe-92bf-1219524bfae2\") " pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:52:14.999874 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.999731    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c3a36c3-8585-42fe-92bf-1219524bfae2-model-cache\") pod \"sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92\" (UID: \"1c3a36c3-8585-42fe-92bf-1219524bfae2\") " pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:52:14.999874 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.999747    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c3a36c3-8585-42fe-92bf-1219524bfae2-dshm\") pod \"sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92\" (UID: \"1c3a36c3-8585-42fe-92bf-1219524bfae2\") " pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:52:14.999874 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.999769    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv82t\" (UniqueName: \"kubernetes.io/projected/1c3a36c3-8585-42fe-92bf-1219524bfae2-kube-api-access-mv82t\") pod \"sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92\" (UID: \"1c3a36c3-8585-42fe-92bf-1219524bfae2\") " pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:52:14.999874 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:14.999791    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c3a36c3-8585-42fe-92bf-1219524bfae2-tls-certs\") pod \"sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92\" (UID: \"1c3a36c3-8585-42fe-92bf-1219524bfae2\") " pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:52:15.000211 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:15.000185    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c3a36c3-8585-42fe-92bf-1219524bfae2-home\") pod \"sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92\" (UID: \"1c3a36c3-8585-42fe-92bf-1219524bfae2\") " pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:52:15.000293 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:15.000200    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c3a36c3-8585-42fe-92bf-1219524bfae2-model-cache\") pod \"sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92\" (UID: \"1c3a36c3-8585-42fe-92bf-1219524bfae2\") " pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:52:15.000293 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:15.000240    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c3a36c3-8585-42fe-92bf-1219524bfae2-tmp-dir\") pod \"sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92\" (UID: \"1c3a36c3-8585-42fe-92bf-1219524bfae2\") " pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:52:15.002098 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:15.002078    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c3a36c3-8585-42fe-92bf-1219524bfae2-dshm\") pod \"sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92\" (UID: \"1c3a36c3-8585-42fe-92bf-1219524bfae2\") " pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:52:15.002344 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:15.002327    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c3a36c3-8585-42fe-92bf-1219524bfae2-tls-certs\") pod \"sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92\" (UID: \"1c3a36c3-8585-42fe-92bf-1219524bfae2\") " pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:52:15.008414 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:15.008383    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv82t\" (UniqueName: \"kubernetes.io/projected/1c3a36c3-8585-42fe-92bf-1219524bfae2-kube-api-access-mv82t\") pod \"sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92\" (UID: \"1c3a36c3-8585-42fe-92bf-1219524bfae2\") " pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:52:15.153908 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:15.153815    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:52:15.295790 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:15.295764    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"]
Aug 04 00:52:15.297833 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:52:15.297803    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c3a36c3_8585_42fe_92bf_1219524bfae2.slice/crio-267648f689544d9d2228a53e88df0869e18b21ce702c8e41664cdb0a506494d4 WatchSource:0}: Error finding container 267648f689544d9d2228a53e88df0869e18b21ce702c8e41664cdb0a506494d4: Status 404 returned error can't find the container with id 267648f689544d9d2228a53e88df0869e18b21ce702c8e41664cdb0a506494d4
Aug 04 00:52:15.339694 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:15.339661    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92" event={"ID":"1c3a36c3-8585-42fe-92bf-1219524bfae2","Type":"ContainerStarted","Data":"267648f689544d9d2228a53e88df0869e18b21ce702c8e41664cdb0a506494d4"}
Aug 04 00:52:16.345946 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:16.345905    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92" event={"ID":"1c3a36c3-8585-42fe-92bf-1219524bfae2","Type":"ContainerStarted","Data":"939d83560d849ab1c4a81b3c42f8f1ca42928aaea65a9e526c7cd6081d4a77e3"}
Aug 04 00:52:16.363524 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:16.363469    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92" podStartSLOduration=2.363449639 podStartE2EDuration="2.363449639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:52:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:52:16.361162081 +0000 UTC m=+2990.529799451" watchObservedRunningTime="2026-08-04 00:52:16.363449639 +0000 UTC m=+2990.532087010"
Aug 04 00:52:25.154185 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:25.154143    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:52:25.154653 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:25.154211    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:52:25.166694 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:25.166663    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:52:25.404979 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:25.404897    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:52:26.488376 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:26.488346    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:52:26.497731 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:26.497687    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:52:26.695757 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:52:26.695727    2556 scope.go:117] "RemoveContainer" containerID="35cd88cf63894c6ea1c85b2402229a9a8797879772a5bab192a4aea39ef5b630"
Aug 04 00:53:08.714967 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.714936    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"]
Aug 04 00:53:08.718673 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.718649    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:53:08.721318 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.721294    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5396f3\"/\"kube-root-ca.crt\""
Aug 04 00:53:08.721436 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.721323    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5396f3\"/\"openshift-service-ca.crt\""
Aug 04 00:53:08.722176 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.722161    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5396f3\"/\"default-dockercfg-tw28l\""
Aug 04 00:53:08.722405 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.722382    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5396f3\"/\"sub-test-model-5396f3-kserve-self-signed-certs\""
Aug 04 00:53:08.727209 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.727186    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"]
Aug 04 00:53:08.842384 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.842343    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee5bce02-3663-4816-b81f-4d32e9a82c40-home\") pod \"sub-test-model-5396f3-kserve-745d4749c5-srq4k\" (UID: \"ee5bce02-3663-4816-b81f-4d32e9a82c40\") " pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:53:08.842638 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.842420    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee5bce02-3663-4816-b81f-4d32e9a82c40-dshm\") pod \"sub-test-model-5396f3-kserve-745d4749c5-srq4k\" (UID: \"ee5bce02-3663-4816-b81f-4d32e9a82c40\") " pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:53:08.842638 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.842526    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee5bce02-3663-4816-b81f-4d32e9a82c40-model-cache\") pod \"sub-test-model-5396f3-kserve-745d4749c5-srq4k\" (UID: \"ee5bce02-3663-4816-b81f-4d32e9a82c40\") " pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:53:08.842638 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.842591    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee5bce02-3663-4816-b81f-4d32e9a82c40-tls-certs\") pod \"sub-test-model-5396f3-kserve-745d4749c5-srq4k\" (UID: \"ee5bce02-3663-4816-b81f-4d32e9a82c40\") " pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:53:08.842638 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.842623    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx2h7\" (UniqueName: \"kubernetes.io/projected/ee5bce02-3663-4816-b81f-4d32e9a82c40-kube-api-access-wx2h7\") pod \"sub-test-model-5396f3-kserve-745d4749c5-srq4k\" (UID: \"ee5bce02-3663-4816-b81f-4d32e9a82c40\") " pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:53:08.842908 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.842674    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee5bce02-3663-4816-b81f-4d32e9a82c40-tmp-dir\") pod \"sub-test-model-5396f3-kserve-745d4749c5-srq4k\" (UID: \"ee5bce02-3663-4816-b81f-4d32e9a82c40\") " pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:53:08.944037 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.943986    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee5bce02-3663-4816-b81f-4d32e9a82c40-tls-certs\") pod \"sub-test-model-5396f3-kserve-745d4749c5-srq4k\" (UID: \"ee5bce02-3663-4816-b81f-4d32e9a82c40\") " pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:53:08.944037 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.944052    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx2h7\" (UniqueName: \"kubernetes.io/projected/ee5bce02-3663-4816-b81f-4d32e9a82c40-kube-api-access-wx2h7\") pod \"sub-test-model-5396f3-kserve-745d4749c5-srq4k\" (UID: \"ee5bce02-3663-4816-b81f-4d32e9a82c40\") " pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:53:08.944268 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.944114    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee5bce02-3663-4816-b81f-4d32e9a82c40-tmp-dir\") pod \"sub-test-model-5396f3-kserve-745d4749c5-srq4k\" (UID: \"ee5bce02-3663-4816-b81f-4d32e9a82c40\") " pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:53:08.944268 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.944228    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee5bce02-3663-4816-b81f-4d32e9a82c40-home\") pod \"sub-test-model-5396f3-kserve-745d4749c5-srq4k\" (UID: \"ee5bce02-3663-4816-b81f-4d32e9a82c40\") " pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:53:08.944407 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.944383    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee5bce02-3663-4816-b81f-4d32e9a82c40-dshm\") pod \"sub-test-model-5396f3-kserve-745d4749c5-srq4k\" (UID: \"ee5bce02-3663-4816-b81f-4d32e9a82c40\") " pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:53:08.944520 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.944504    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee5bce02-3663-4816-b81f-4d32e9a82c40-model-cache\") pod \"sub-test-model-5396f3-kserve-745d4749c5-srq4k\" (UID: \"ee5bce02-3663-4816-b81f-4d32e9a82c40\") " pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:53:08.944601 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.944526    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee5bce02-3663-4816-b81f-4d32e9a82c40-tmp-dir\") pod \"sub-test-model-5396f3-kserve-745d4749c5-srq4k\" (UID: \"ee5bce02-3663-4816-b81f-4d32e9a82c40\") " pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:53:08.944660 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.944596    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee5bce02-3663-4816-b81f-4d32e9a82c40-home\") pod \"sub-test-model-5396f3-kserve-745d4749c5-srq4k\" (UID: \"ee5bce02-3663-4816-b81f-4d32e9a82c40\") " pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:53:08.944801 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.944779    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee5bce02-3663-4816-b81f-4d32e9a82c40-model-cache\") pod \"sub-test-model-5396f3-kserve-745d4749c5-srq4k\" (UID: \"ee5bce02-3663-4816-b81f-4d32e9a82c40\") " pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:53:08.946491 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.946469    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee5bce02-3663-4816-b81f-4d32e9a82c40-dshm\") pod \"sub-test-model-5396f3-kserve-745d4749c5-srq4k\" (UID: \"ee5bce02-3663-4816-b81f-4d32e9a82c40\") " pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:53:08.946820 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.946801    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee5bce02-3663-4816-b81f-4d32e9a82c40-tls-certs\") pod \"sub-test-model-5396f3-kserve-745d4749c5-srq4k\" (UID: \"ee5bce02-3663-4816-b81f-4d32e9a82c40\") " pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:53:08.952627 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:08.952606    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx2h7\" (UniqueName: \"kubernetes.io/projected/ee5bce02-3663-4816-b81f-4d32e9a82c40-kube-api-access-wx2h7\") pod \"sub-test-model-5396f3-kserve-745d4749c5-srq4k\" (UID: \"ee5bce02-3663-4816-b81f-4d32e9a82c40\") " pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:53:09.029790 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:09.029755    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:53:09.177912 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:09.177878    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"]
Aug 04 00:53:09.181022 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:53:09.180994    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee5bce02_3663_4816_b81f_4d32e9a82c40.slice/crio-10038e00b58e9fe3d3a47f1a3abbea7677a324ae8baf8cadf9de10865f6c7be2 WatchSource:0}: Error finding container 10038e00b58e9fe3d3a47f1a3abbea7677a324ae8baf8cadf9de10865f6c7be2: Status 404 returned error can't find the container with id 10038e00b58e9fe3d3a47f1a3abbea7677a324ae8baf8cadf9de10865f6c7be2
Aug 04 00:53:09.630172 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:09.630134    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k" event={"ID":"ee5bce02-3663-4816-b81f-4d32e9a82c40","Type":"ContainerStarted","Data":"92703c0a5813126affe50d8cddceb0f78de3676a54027dd9f0db38494295ab67"}
Aug 04 00:53:09.630172 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:09.630179    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k" event={"ID":"ee5bce02-3663-4816-b81f-4d32e9a82c40","Type":"ContainerStarted","Data":"10038e00b58e9fe3d3a47f1a3abbea7677a324ae8baf8cadf9de10865f6c7be2"}
Aug 04 00:53:09.646318 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:09.646262    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k" podStartSLOduration=1.646240378 podStartE2EDuration="1.646240378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:53:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:53:09.645985052 +0000 UTC m=+3043.814622433" watchObservedRunningTime="2026-08-04 00:53:09.646240378 +0000 UTC m=+3043.814877758"
Aug 04 00:53:19.030368 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:19.030277    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:53:19.030368 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:19.030341    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:53:19.042756 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:19.042726    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:53:19.694434 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:53:19.694391    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:54:14.522354 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:14.522312    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"]
Aug 04 00:54:15.428837 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:15.428797    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"]
Aug 04 00:54:29.108321 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.108280    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"]
Aug 04 00:54:29.111943 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.111923    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:54:29.114468 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.114425    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a5b2e0\"/\"rate-test-model-a5b2e0-kserve-self-signed-certs\""
Aug 04 00:54:29.121157 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.121130    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"]
Aug 04 00:54:29.166840 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.166803    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3d5f8d1-992d-43b5-bcb5-941645e7311e-home\") pod \"rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw\" (UID: \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\") " pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:54:29.167059 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.166929    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3d5f8d1-992d-43b5-bcb5-941645e7311e-dshm\") pod \"rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw\" (UID: \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\") " pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:54:29.167059 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.167009    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2m2b\" (UniqueName: \"kubernetes.io/projected/d3d5f8d1-992d-43b5-bcb5-941645e7311e-kube-api-access-j2m2b\") pod \"rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw\" (UID: \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\") " pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:54:29.167198 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.167082    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3d5f8d1-992d-43b5-bcb5-941645e7311e-model-cache\") pod \"rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw\" (UID: \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\") " pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:54:29.167198 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.167115    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3d5f8d1-992d-43b5-bcb5-941645e7311e-tls-certs\") pod \"rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw\" (UID: \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\") " pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:54:29.167198 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.167150    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3d5f8d1-992d-43b5-bcb5-941645e7311e-tmp-dir\") pod \"rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw\" (UID: \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\") " pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:54:29.268157 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.268125    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3d5f8d1-992d-43b5-bcb5-941645e7311e-dshm\") pod \"rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw\" (UID: \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\") " pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:54:29.268362 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.268178    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2m2b\" (UniqueName: \"kubernetes.io/projected/d3d5f8d1-992d-43b5-bcb5-941645e7311e-kube-api-access-j2m2b\") pod \"rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw\" (UID: \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\") " pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:54:29.268362 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.268222    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3d5f8d1-992d-43b5-bcb5-941645e7311e-model-cache\") pod \"rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw\" (UID: \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\") " pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:54:29.268362 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.268244    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3d5f8d1-992d-43b5-bcb5-941645e7311e-tls-certs\") pod \"rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw\" (UID: \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\") " pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:54:29.268362 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.268271    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3d5f8d1-992d-43b5-bcb5-941645e7311e-tmp-dir\") pod \"rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw\" (UID: \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\") " pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:54:29.268362 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.268306    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3d5f8d1-992d-43b5-bcb5-941645e7311e-home\") pod \"rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw\" (UID: \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\") " pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:54:29.268825 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.268732    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3d5f8d1-992d-43b5-bcb5-941645e7311e-home\") pod \"rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw\" (UID: \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\") " pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:54:29.268825 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.268763    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3d5f8d1-992d-43b5-bcb5-941645e7311e-model-cache\") pod \"rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw\" (UID: \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\") " pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:54:29.269168 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.268851    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3d5f8d1-992d-43b5-bcb5-941645e7311e-tmp-dir\") pod \"rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw\" (UID: \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\") " pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:54:29.270920 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.270883    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3d5f8d1-992d-43b5-bcb5-941645e7311e-tls-certs\") pod \"rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw\" (UID: \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\") " pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:54:29.271043 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.270883    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3d5f8d1-992d-43b5-bcb5-941645e7311e-dshm\") pod \"rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw\" (UID: \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\") " pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:54:29.276608 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.276573    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2m2b\" (UniqueName: \"kubernetes.io/projected/d3d5f8d1-992d-43b5-bcb5-941645e7311e-kube-api-access-j2m2b\") pod \"rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw\" (UID: \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\") " pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:54:29.422102 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.421997    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:54:29.542860 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.542629    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92" podUID="1c3a36c3-8585-42fe-92bf-1219524bfae2" containerName="main" containerID="cri-o://939d83560d849ab1c4a81b3c42f8f1ca42928aaea65a9e526c7cd6081d4a77e3" gracePeriod=45
Aug 04 00:54:29.571196 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.571169    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"]
Aug 04 00:54:29.607813 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:54:29.607769    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3d5f8d1_992d_43b5_bcb5_941645e7311e.slice/crio-7d984cf97178a52b97fef660babbdafc440c30a44a2644f04caa5f9d99bd4b91 WatchSource:0}: Error finding container 7d984cf97178a52b97fef660babbdafc440c30a44a2644f04caa5f9d99bd4b91: Status 404 returned error can't find the container with id 7d984cf97178a52b97fef660babbdafc440c30a44a2644f04caa5f9d99bd4b91
Aug 04 00:54:29.788977 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.788945    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:54:29.873442 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.873402    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c3a36c3-8585-42fe-92bf-1219524bfae2-model-cache\") pod \"1c3a36c3-8585-42fe-92bf-1219524bfae2\" (UID: \"1c3a36c3-8585-42fe-92bf-1219524bfae2\") "
Aug 04 00:54:29.873442 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.873449    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv82t\" (UniqueName: \"kubernetes.io/projected/1c3a36c3-8585-42fe-92bf-1219524bfae2-kube-api-access-mv82t\") pod \"1c3a36c3-8585-42fe-92bf-1219524bfae2\" (UID: \"1c3a36c3-8585-42fe-92bf-1219524bfae2\") "
Aug 04 00:54:29.873703 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.873482    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c3a36c3-8585-42fe-92bf-1219524bfae2-tmp-dir\") pod \"1c3a36c3-8585-42fe-92bf-1219524bfae2\" (UID: \"1c3a36c3-8585-42fe-92bf-1219524bfae2\") "
Aug 04 00:54:29.873703 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.873502    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c3a36c3-8585-42fe-92bf-1219524bfae2-home\") pod \"1c3a36c3-8585-42fe-92bf-1219524bfae2\" (UID: \"1c3a36c3-8585-42fe-92bf-1219524bfae2\") "
Aug 04 00:54:29.873703 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.873520    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c3a36c3-8585-42fe-92bf-1219524bfae2-dshm\") pod \"1c3a36c3-8585-42fe-92bf-1219524bfae2\" (UID: \"1c3a36c3-8585-42fe-92bf-1219524bfae2\") "
Aug 04 00:54:29.873703 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.873538    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c3a36c3-8585-42fe-92bf-1219524bfae2-tls-certs\") pod \"1c3a36c3-8585-42fe-92bf-1219524bfae2\" (UID: \"1c3a36c3-8585-42fe-92bf-1219524bfae2\") "
Aug 04 00:54:29.873972 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.873792    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c3a36c3-8585-42fe-92bf-1219524bfae2-model-cache" (OuterVolumeSpecName: "model-cache") pod "1c3a36c3-8585-42fe-92bf-1219524bfae2" (UID: "1c3a36c3-8585-42fe-92bf-1219524bfae2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:54:29.873972 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.873807    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c3a36c3-8585-42fe-92bf-1219524bfae2-home" (OuterVolumeSpecName: "home") pod "1c3a36c3-8585-42fe-92bf-1219524bfae2" (UID: "1c3a36c3-8585-42fe-92bf-1219524bfae2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:54:29.873972 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.873818    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c3a36c3-8585-42fe-92bf-1219524bfae2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1c3a36c3-8585-42fe-92bf-1219524bfae2" (UID: "1c3a36c3-8585-42fe-92bf-1219524bfae2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:54:29.874124 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.873974    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c3a36c3-8585-42fe-92bf-1219524bfae2-model-cache\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:54:29.874124 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.873989    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c3a36c3-8585-42fe-92bf-1219524bfae2-tmp-dir\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:54:29.874124 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.873997    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c3a36c3-8585-42fe-92bf-1219524bfae2-home\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:54:29.875830 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.875802    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c3a36c3-8585-42fe-92bf-1219524bfae2-dshm" (OuterVolumeSpecName: "dshm") pod "1c3a36c3-8585-42fe-92bf-1219524bfae2" (UID: "1c3a36c3-8585-42fe-92bf-1219524bfae2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:54:29.875940 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.875840    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c3a36c3-8585-42fe-92bf-1219524bfae2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1c3a36c3-8585-42fe-92bf-1219524bfae2" (UID: "1c3a36c3-8585-42fe-92bf-1219524bfae2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:54:29.875940 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.875895    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c3a36c3-8585-42fe-92bf-1219524bfae2-kube-api-access-mv82t" (OuterVolumeSpecName: "kube-api-access-mv82t") pod "1c3a36c3-8585-42fe-92bf-1219524bfae2" (UID: "1c3a36c3-8585-42fe-92bf-1219524bfae2"). InnerVolumeSpecName "kube-api-access-mv82t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:54:29.974567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.974481    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv82t\" (UniqueName: \"kubernetes.io/projected/1c3a36c3-8585-42fe-92bf-1219524bfae2-kube-api-access-mv82t\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:54:29.974567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.974510    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c3a36c3-8585-42fe-92bf-1219524bfae2-dshm\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:54:29.974567 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:29.974519    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c3a36c3-8585-42fe-92bf-1219524bfae2-tls-certs\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:54:30.050095 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.050052    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw" event={"ID":"d3d5f8d1-992d-43b5-bcb5-941645e7311e","Type":"ContainerStarted","Data":"1f41dc365623b36be3cf81374fadd55ea82b320ac9c3c771dfa1e788905c9046"}
Aug 04 00:54:30.050339 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.050103    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw" event={"ID":"d3d5f8d1-992d-43b5-bcb5-941645e7311e","Type":"ContainerStarted","Data":"7d984cf97178a52b97fef660babbdafc440c30a44a2644f04caa5f9d99bd4b91"}
Aug 04 00:54:30.051471 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.051449    2556 generic.go:356] "Generic (PLEG): container finished" podID="1c3a36c3-8585-42fe-92bf-1219524bfae2" containerID="939d83560d849ab1c4a81b3c42f8f1ca42928aaea65a9e526c7cd6081d4a77e3" exitCode=0
Aug 04 00:54:30.051563 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.051479    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92" event={"ID":"1c3a36c3-8585-42fe-92bf-1219524bfae2","Type":"ContainerDied","Data":"939d83560d849ab1c4a81b3c42f8f1ca42928aaea65a9e526c7cd6081d4a77e3"}
Aug 04 00:54:30.051563 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.051489    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"
Aug 04 00:54:30.051563 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.051500    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92" event={"ID":"1c3a36c3-8585-42fe-92bf-1219524bfae2","Type":"ContainerDied","Data":"267648f689544d9d2228a53e88df0869e18b21ce702c8e41664cdb0a506494d4"}
Aug 04 00:54:30.051563 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.051516    2556 scope.go:117] "RemoveContainer" containerID="939d83560d849ab1c4a81b3c42f8f1ca42928aaea65a9e526c7cd6081d4a77e3"
Aug 04 00:54:30.060809 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.060786    2556 scope.go:117] "RemoveContainer" containerID="939d83560d849ab1c4a81b3c42f8f1ca42928aaea65a9e526c7cd6081d4a77e3"
Aug 04 00:54:30.061129 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:54:30.061109    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"939d83560d849ab1c4a81b3c42f8f1ca42928aaea65a9e526c7cd6081d4a77e3\": container with ID starting with 939d83560d849ab1c4a81b3c42f8f1ca42928aaea65a9e526c7cd6081d4a77e3 not found: ID does not exist" containerID="939d83560d849ab1c4a81b3c42f8f1ca42928aaea65a9e526c7cd6081d4a77e3"
Aug 04 00:54:30.061195 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.061139    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"939d83560d849ab1c4a81b3c42f8f1ca42928aaea65a9e526c7cd6081d4a77e3"} err="failed to get container status \"939d83560d849ab1c4a81b3c42f8f1ca42928aaea65a9e526c7cd6081d4a77e3\": rpc error: code = NotFound desc = could not find container \"939d83560d849ab1c4a81b3c42f8f1ca42928aaea65a9e526c7cd6081d4a77e3\": container with ID starting with 939d83560d849ab1c4a81b3c42f8f1ca42928aaea65a9e526c7cd6081d4a77e3 not found: ID does not exist"
Aug 04 00:54:30.068477 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.068421    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw" podStartSLOduration=1.068402622 podStartE2EDuration="1.068402622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:54:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:54:30.067491516 +0000 UTC m=+3124.236128888" watchObservedRunningTime="2026-08-04 00:54:30.068402622 +0000 UTC m=+3124.237039991"
Aug 04 00:54:30.081018 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.080979    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"]
Aug 04 00:54:30.085656 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.085621    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a5b2e0/sub-test-model-a5b2e0-kserve-84d9fc495c-8dj92"]
Aug 04 00:54:30.307520 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.307484    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c3a36c3-8585-42fe-92bf-1219524bfae2" path="/var/lib/kubelet/pods/1c3a36c3-8585-42fe-92bf-1219524bfae2/volumes"
Aug 04 00:54:30.447846 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.447802    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k" podUID="ee5bce02-3663-4816-b81f-4d32e9a82c40" containerName="main" containerID="cri-o://92703c0a5813126affe50d8cddceb0f78de3676a54027dd9f0db38494295ab67" gracePeriod=45
Aug 04 00:54:30.710390 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.710364    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:54:30.782606 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.782574    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee5bce02-3663-4816-b81f-4d32e9a82c40-tmp-dir\") pod \"ee5bce02-3663-4816-b81f-4d32e9a82c40\" (UID: \"ee5bce02-3663-4816-b81f-4d32e9a82c40\") "
Aug 04 00:54:30.782790 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.782639    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee5bce02-3663-4816-b81f-4d32e9a82c40-model-cache\") pod \"ee5bce02-3663-4816-b81f-4d32e9a82c40\" (UID: \"ee5bce02-3663-4816-b81f-4d32e9a82c40\") "
Aug 04 00:54:30.782790 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.782667    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wx2h7\" (UniqueName: \"kubernetes.io/projected/ee5bce02-3663-4816-b81f-4d32e9a82c40-kube-api-access-wx2h7\") pod \"ee5bce02-3663-4816-b81f-4d32e9a82c40\" (UID: \"ee5bce02-3663-4816-b81f-4d32e9a82c40\") "
Aug 04 00:54:30.782790 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.782747    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee5bce02-3663-4816-b81f-4d32e9a82c40-tls-certs\") pod \"ee5bce02-3663-4816-b81f-4d32e9a82c40\" (UID: \"ee5bce02-3663-4816-b81f-4d32e9a82c40\") "
Aug 04 00:54:30.782790 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.782777    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee5bce02-3663-4816-b81f-4d32e9a82c40-home\") pod \"ee5bce02-3663-4816-b81f-4d32e9a82c40\" (UID: \"ee5bce02-3663-4816-b81f-4d32e9a82c40\") "
Aug 04 00:54:30.783018 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.782870    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee5bce02-3663-4816-b81f-4d32e9a82c40-dshm\") pod \"ee5bce02-3663-4816-b81f-4d32e9a82c40\" (UID: \"ee5bce02-3663-4816-b81f-4d32e9a82c40\") "
Aug 04 00:54:30.783018 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.782928    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5bce02-3663-4816-b81f-4d32e9a82c40-model-cache" (OuterVolumeSpecName: "model-cache") pod "ee5bce02-3663-4816-b81f-4d32e9a82c40" (UID: "ee5bce02-3663-4816-b81f-4d32e9a82c40"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:54:30.783018 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.782924    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5bce02-3663-4816-b81f-4d32e9a82c40-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ee5bce02-3663-4816-b81f-4d32e9a82c40" (UID: "ee5bce02-3663-4816-b81f-4d32e9a82c40"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:54:30.783182 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.783094    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5bce02-3663-4816-b81f-4d32e9a82c40-home" (OuterVolumeSpecName: "home") pod "ee5bce02-3663-4816-b81f-4d32e9a82c40" (UID: "ee5bce02-3663-4816-b81f-4d32e9a82c40"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:54:30.783276 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.783255    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee5bce02-3663-4816-b81f-4d32e9a82c40-tmp-dir\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:54:30.783360 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.783278    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee5bce02-3663-4816-b81f-4d32e9a82c40-model-cache\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:54:30.783360 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.783290    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee5bce02-3663-4816-b81f-4d32e9a82c40-home\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:54:30.784928 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.784904    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5bce02-3663-4816-b81f-4d32e9a82c40-dshm" (OuterVolumeSpecName: "dshm") pod "ee5bce02-3663-4816-b81f-4d32e9a82c40" (UID: "ee5bce02-3663-4816-b81f-4d32e9a82c40"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:54:30.784928 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.784924    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee5bce02-3663-4816-b81f-4d32e9a82c40-kube-api-access-wx2h7" (OuterVolumeSpecName: "kube-api-access-wx2h7") pod "ee5bce02-3663-4816-b81f-4d32e9a82c40" (UID: "ee5bce02-3663-4816-b81f-4d32e9a82c40"). InnerVolumeSpecName "kube-api-access-wx2h7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:54:30.785079 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.784907    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee5bce02-3663-4816-b81f-4d32e9a82c40-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ee5bce02-3663-4816-b81f-4d32e9a82c40" (UID: "ee5bce02-3663-4816-b81f-4d32e9a82c40"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:54:30.884798 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.884681    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee5bce02-3663-4816-b81f-4d32e9a82c40-dshm\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:54:30.884798 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.884736    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx2h7\" (UniqueName: \"kubernetes.io/projected/ee5bce02-3663-4816-b81f-4d32e9a82c40-kube-api-access-wx2h7\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:54:30.884798 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:30.884752    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee5bce02-3663-4816-b81f-4d32e9a82c40-tls-certs\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:54:31.058792 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:31.058757    2556 generic.go:356] "Generic (PLEG): container finished" podID="ee5bce02-3663-4816-b81f-4d32e9a82c40" containerID="92703c0a5813126affe50d8cddceb0f78de3676a54027dd9f0db38494295ab67" exitCode=0
Aug 04 00:54:31.058992 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:31.058848    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"
Aug 04 00:54:31.058992 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:31.058842    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k" event={"ID":"ee5bce02-3663-4816-b81f-4d32e9a82c40","Type":"ContainerDied","Data":"92703c0a5813126affe50d8cddceb0f78de3676a54027dd9f0db38494295ab67"}
Aug 04 00:54:31.058992 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:31.058899    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k" event={"ID":"ee5bce02-3663-4816-b81f-4d32e9a82c40","Type":"ContainerDied","Data":"10038e00b58e9fe3d3a47f1a3abbea7677a324ae8baf8cadf9de10865f6c7be2"}
Aug 04 00:54:31.058992 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:31.058928    2556 scope.go:117] "RemoveContainer" containerID="92703c0a5813126affe50d8cddceb0f78de3676a54027dd9f0db38494295ab67"
Aug 04 00:54:31.068587 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:31.068559    2556 scope.go:117] "RemoveContainer" containerID="92703c0a5813126affe50d8cddceb0f78de3676a54027dd9f0db38494295ab67"
Aug 04 00:54:31.068899 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:54:31.068881    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92703c0a5813126affe50d8cddceb0f78de3676a54027dd9f0db38494295ab67\": container with ID starting with 92703c0a5813126affe50d8cddceb0f78de3676a54027dd9f0db38494295ab67 not found: ID does not exist" containerID="92703c0a5813126affe50d8cddceb0f78de3676a54027dd9f0db38494295ab67"
Aug 04 00:54:31.068962 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:31.068908    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92703c0a5813126affe50d8cddceb0f78de3676a54027dd9f0db38494295ab67"} err="failed to get container status \"92703c0a5813126affe50d8cddceb0f78de3676a54027dd9f0db38494295ab67\": rpc error: code = NotFound desc = could not find container \"92703c0a5813126affe50d8cddceb0f78de3676a54027dd9f0db38494295ab67\": container with ID starting with 92703c0a5813126affe50d8cddceb0f78de3676a54027dd9f0db38494295ab67 not found: ID does not exist"
Aug 04 00:54:31.081123 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:31.081090    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"]
Aug 04 00:54:31.084806 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:31.084770    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-5396f3/sub-test-model-5396f3-kserve-745d4749c5-srq4k"]
Aug 04 00:54:32.308100 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:32.308064    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee5bce02-3663-4816-b81f-4d32e9a82c40" path="/var/lib/kubelet/pods/ee5bce02-3663-4816-b81f-4d32e9a82c40/volumes"
Aug 04 00:54:39.422683 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:39.422634    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:54:39.423242 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:39.422701    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:54:39.435579 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:39.435545    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:54:40.119178 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:40.119146    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:54:59.710003 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.709926    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"]
Aug 04 00:54:59.710454 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.710307    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee5bce02-3663-4816-b81f-4d32e9a82c40" containerName="main"
Aug 04 00:54:59.710454 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.710317    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee5bce02-3663-4816-b81f-4d32e9a82c40" containerName="main"
Aug 04 00:54:59.710454 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.710339    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c3a36c3-8585-42fe-92bf-1219524bfae2" containerName="main"
Aug 04 00:54:59.710454 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.710344    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c3a36c3-8585-42fe-92bf-1219524bfae2" containerName="main"
Aug 04 00:54:59.710454 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.710404    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c3a36c3-8585-42fe-92bf-1219524bfae2" containerName="main"
Aug 04 00:54:59.710454 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.710426    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee5bce02-3663-4816-b81f-4d32e9a82c40" containerName="main"
Aug 04 00:54:59.713757 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.713735    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:54:59.717013 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.716989    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5396f3\"/\"openshift-service-ca.crt\""
Aug 04 00:54:59.717145 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.716990    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5396f3\"/\"rate-test-model-5396f3-kserve-self-signed-certs\""
Aug 04 00:54:59.717145 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.717045    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5396f3\"/\"default-dockercfg-tw28l\""
Aug 04 00:54:59.717145 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.717016    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5396f3\"/\"kube-root-ca.crt\""
Aug 04 00:54:59.724904 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.724880    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"]
Aug 04 00:54:59.867452 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.867406    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79b19b37-6ced-4a32-b1ee-6add3d57220e-home\") pod \"rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt\" (UID: \"79b19b37-6ced-4a32-b1ee-6add3d57220e\") " pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:54:59.867662 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.867482    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79b19b37-6ced-4a32-b1ee-6add3d57220e-tmp-dir\") pod \"rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt\" (UID: \"79b19b37-6ced-4a32-b1ee-6add3d57220e\") " pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:54:59.867662 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.867513    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79b19b37-6ced-4a32-b1ee-6add3d57220e-tls-certs\") pod \"rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt\" (UID: \"79b19b37-6ced-4a32-b1ee-6add3d57220e\") " pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:54:59.867662 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.867561    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56m2w\" (UniqueName: \"kubernetes.io/projected/79b19b37-6ced-4a32-b1ee-6add3d57220e-kube-api-access-56m2w\") pod \"rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt\" (UID: \"79b19b37-6ced-4a32-b1ee-6add3d57220e\") " pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:54:59.867857 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.867670    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79b19b37-6ced-4a32-b1ee-6add3d57220e-model-cache\") pod \"rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt\" (UID: \"79b19b37-6ced-4a32-b1ee-6add3d57220e\") " pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:54:59.867857 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.867766    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79b19b37-6ced-4a32-b1ee-6add3d57220e-dshm\") pod \"rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt\" (UID: \"79b19b37-6ced-4a32-b1ee-6add3d57220e\") " pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:54:59.968439 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.968336    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79b19b37-6ced-4a32-b1ee-6add3d57220e-model-cache\") pod \"rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt\" (UID: \"79b19b37-6ced-4a32-b1ee-6add3d57220e\") " pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:54:59.968439 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.968396    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79b19b37-6ced-4a32-b1ee-6add3d57220e-dshm\") pod \"rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt\" (UID: \"79b19b37-6ced-4a32-b1ee-6add3d57220e\") " pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:54:59.968439 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.968428    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79b19b37-6ced-4a32-b1ee-6add3d57220e-home\") pod \"rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt\" (UID: \"79b19b37-6ced-4a32-b1ee-6add3d57220e\") " pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:54:59.968787 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.968480    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79b19b37-6ced-4a32-b1ee-6add3d57220e-tmp-dir\") pod \"rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt\" (UID: \"79b19b37-6ced-4a32-b1ee-6add3d57220e\") " pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:54:59.968787 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.968502    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79b19b37-6ced-4a32-b1ee-6add3d57220e-tls-certs\") pod \"rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt\" (UID: \"79b19b37-6ced-4a32-b1ee-6add3d57220e\") " pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:54:59.968787 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.968550    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56m2w\" (UniqueName: \"kubernetes.io/projected/79b19b37-6ced-4a32-b1ee-6add3d57220e-kube-api-access-56m2w\") pod \"rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt\" (UID: \"79b19b37-6ced-4a32-b1ee-6add3d57220e\") " pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:54:59.968938 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.968844    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79b19b37-6ced-4a32-b1ee-6add3d57220e-model-cache\") pod \"rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt\" (UID: \"79b19b37-6ced-4a32-b1ee-6add3d57220e\") " pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:54:59.968938 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.968882    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79b19b37-6ced-4a32-b1ee-6add3d57220e-home\") pod \"rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt\" (UID: \"79b19b37-6ced-4a32-b1ee-6add3d57220e\") " pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:54:59.968938 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.968910    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79b19b37-6ced-4a32-b1ee-6add3d57220e-tmp-dir\") pod \"rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt\" (UID: \"79b19b37-6ced-4a32-b1ee-6add3d57220e\") " pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:54:59.970790 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.970762    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79b19b37-6ced-4a32-b1ee-6add3d57220e-dshm\") pod \"rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt\" (UID: \"79b19b37-6ced-4a32-b1ee-6add3d57220e\") " pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:54:59.971050 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.971032    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79b19b37-6ced-4a32-b1ee-6add3d57220e-tls-certs\") pod \"rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt\" (UID: \"79b19b37-6ced-4a32-b1ee-6add3d57220e\") " pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:54:59.977330 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:54:59.977304    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56m2w\" (UniqueName: \"kubernetes.io/projected/79b19b37-6ced-4a32-b1ee-6add3d57220e-kube-api-access-56m2w\") pod \"rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt\" (UID: \"79b19b37-6ced-4a32-b1ee-6add3d57220e\") " pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:55:00.024344 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:55:00.024306    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:55:00.170490 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:55:00.170455    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"]
Aug 04 00:55:00.172485 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:55:00.172456    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79b19b37_6ced_4a32_b1ee_6add3d57220e.slice/crio-15d400d0d33593bde74d9dcf5c10afcd05e5e9b0831d2abda06b9a9530b6a27d WatchSource:0}: Error finding container 15d400d0d33593bde74d9dcf5c10afcd05e5e9b0831d2abda06b9a9530b6a27d: Status 404 returned error can't find the container with id 15d400d0d33593bde74d9dcf5c10afcd05e5e9b0831d2abda06b9a9530b6a27d
Aug 04 00:55:00.211753 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:55:00.211704    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt" event={"ID":"79b19b37-6ced-4a32-b1ee-6add3d57220e","Type":"ContainerStarted","Data":"15d400d0d33593bde74d9dcf5c10afcd05e5e9b0831d2abda06b9a9530b6a27d"}
Aug 04 00:55:01.218685 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:55:01.218642    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt" event={"ID":"79b19b37-6ced-4a32-b1ee-6add3d57220e","Type":"ContainerStarted","Data":"203407977fab6fcba732cb0afe6ebde1e3b4f17480c602587d13d88d0197830d"}
Aug 04 00:55:01.235512 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:55:01.235459    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt" podStartSLOduration=2.23544194 podStartE2EDuration="2.23544194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:54:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:55:01.233776151 +0000 UTC m=+3155.402413521" watchObservedRunningTime="2026-08-04 00:55:01.23544194 +0000 UTC m=+3155.404079341"
Aug 04 00:55:10.025250 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:55:10.025206    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:55:10.025799 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:55:10.025385    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:55:10.037991 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:55:10.037965    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:55:10.277950 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:55:10.277865    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:56:12.475868 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:12.475834    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"]
Aug 04 00:56:13.377137 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:13.377095    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"]
Aug 04 00:56:27.498004 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:27.497892    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw" podUID="d3d5f8d1-992d-43b5-bcb5-941645e7311e" containerName="main" containerID="cri-o://1f41dc365623b36be3cf81374fadd55ea82b320ac9c3c771dfa1e788905c9046" gracePeriod=45
Aug 04 00:56:27.683228 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:27.683192    2556 generic.go:356] "Generic (PLEG): container finished" podID="d3d5f8d1-992d-43b5-bcb5-941645e7311e" containerID="1f41dc365623b36be3cf81374fadd55ea82b320ac9c3c771dfa1e788905c9046" exitCode=0
Aug 04 00:56:27.683439 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:27.683269    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw" event={"ID":"d3d5f8d1-992d-43b5-bcb5-941645e7311e","Type":"ContainerDied","Data":"1f41dc365623b36be3cf81374fadd55ea82b320ac9c3c771dfa1e788905c9046"}
Aug 04 00:56:27.750520 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:27.750458    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:56:27.841794 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:27.841755    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3d5f8d1-992d-43b5-bcb5-941645e7311e-dshm\") pod \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\" (UID: \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\") "
Aug 04 00:56:27.841973 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:27.841801    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3d5f8d1-992d-43b5-bcb5-941645e7311e-tls-certs\") pod \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\" (UID: \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\") "
Aug 04 00:56:27.841973 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:27.841833    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2m2b\" (UniqueName: \"kubernetes.io/projected/d3d5f8d1-992d-43b5-bcb5-941645e7311e-kube-api-access-j2m2b\") pod \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\" (UID: \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\") "
Aug 04 00:56:27.841973 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:27.841928    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3d5f8d1-992d-43b5-bcb5-941645e7311e-model-cache\") pod \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\" (UID: \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\") "
Aug 04 00:56:27.841973 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:27.841965    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3d5f8d1-992d-43b5-bcb5-941645e7311e-home\") pod \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\" (UID: \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\") "
Aug 04 00:56:27.842197 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:27.841993    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3d5f8d1-992d-43b5-bcb5-941645e7311e-tmp-dir\") pod \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\" (UID: \"d3d5f8d1-992d-43b5-bcb5-941645e7311e\") "
Aug 04 00:56:27.842261 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:27.842184    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3d5f8d1-992d-43b5-bcb5-941645e7311e-model-cache" (OuterVolumeSpecName: "model-cache") pod "d3d5f8d1-992d-43b5-bcb5-941645e7311e" (UID: "d3d5f8d1-992d-43b5-bcb5-941645e7311e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:56:27.842314 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:27.842251    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3d5f8d1-992d-43b5-bcb5-941645e7311e-home" (OuterVolumeSpecName: "home") pod "d3d5f8d1-992d-43b5-bcb5-941645e7311e" (UID: "d3d5f8d1-992d-43b5-bcb5-941645e7311e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:56:27.842314 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:27.842275    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3d5f8d1-992d-43b5-bcb5-941645e7311e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d3d5f8d1-992d-43b5-bcb5-941645e7311e" (UID: "d3d5f8d1-992d-43b5-bcb5-941645e7311e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:56:27.842432 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:27.842351    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3d5f8d1-992d-43b5-bcb5-941645e7311e-model-cache\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:56:27.844132 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:27.844108    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3d5f8d1-992d-43b5-bcb5-941645e7311e-dshm" (OuterVolumeSpecName: "dshm") pod "d3d5f8d1-992d-43b5-bcb5-941645e7311e" (UID: "d3d5f8d1-992d-43b5-bcb5-941645e7311e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:56:27.844263 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:27.844145    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3d5f8d1-992d-43b5-bcb5-941645e7311e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d3d5f8d1-992d-43b5-bcb5-941645e7311e" (UID: "d3d5f8d1-992d-43b5-bcb5-941645e7311e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:56:27.844263 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:27.844149    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3d5f8d1-992d-43b5-bcb5-941645e7311e-kube-api-access-j2m2b" (OuterVolumeSpecName: "kube-api-access-j2m2b") pod "d3d5f8d1-992d-43b5-bcb5-941645e7311e" (UID: "d3d5f8d1-992d-43b5-bcb5-941645e7311e"). InnerVolumeSpecName "kube-api-access-j2m2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:56:27.943950 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:27.943903    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3d5f8d1-992d-43b5-bcb5-941645e7311e-home\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:56:27.944142 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:27.943968    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3d5f8d1-992d-43b5-bcb5-941645e7311e-tmp-dir\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:56:27.944142 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:27.943981    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3d5f8d1-992d-43b5-bcb5-941645e7311e-dshm\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:56:27.944142 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:27.943992    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3d5f8d1-992d-43b5-bcb5-941645e7311e-tls-certs\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:56:27.944142 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:27.944003    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2m2b\" (UniqueName: \"kubernetes.io/projected/d3d5f8d1-992d-43b5-bcb5-941645e7311e-kube-api-access-j2m2b\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:56:28.398452 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.398355    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt" podUID="79b19b37-6ced-4a32-b1ee-6add3d57220e" containerName="main" containerID="cri-o://203407977fab6fcba732cb0afe6ebde1e3b4f17480c602587d13d88d0197830d" gracePeriod=45
Aug 04 00:56:28.647550 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.647522    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:56:28.689590 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.689553    2556 generic.go:356] "Generic (PLEG): container finished" podID="79b19b37-6ced-4a32-b1ee-6add3d57220e" containerID="203407977fab6fcba732cb0afe6ebde1e3b4f17480c602587d13d88d0197830d" exitCode=0
Aug 04 00:56:28.689805 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.689609    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"
Aug 04 00:56:28.689805 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.689646    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt" event={"ID":"79b19b37-6ced-4a32-b1ee-6add3d57220e","Type":"ContainerDied","Data":"203407977fab6fcba732cb0afe6ebde1e3b4f17480c602587d13d88d0197830d"}
Aug 04 00:56:28.689805 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.689690    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt" event={"ID":"79b19b37-6ced-4a32-b1ee-6add3d57220e","Type":"ContainerDied","Data":"15d400d0d33593bde74d9dcf5c10afcd05e5e9b0831d2abda06b9a9530b6a27d"}
Aug 04 00:56:28.689805 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.689736    2556 scope.go:117] "RemoveContainer" containerID="203407977fab6fcba732cb0afe6ebde1e3b4f17480c602587d13d88d0197830d"
Aug 04 00:56:28.691020 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.690998    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw" event={"ID":"d3d5f8d1-992d-43b5-bcb5-941645e7311e","Type":"ContainerDied","Data":"7d984cf97178a52b97fef660babbdafc440c30a44a2644f04caa5f9d99bd4b91"}
Aug 04 00:56:28.691083 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.691024    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"
Aug 04 00:56:28.700954 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.700936    2556 scope.go:117] "RemoveContainer" containerID="203407977fab6fcba732cb0afe6ebde1e3b4f17480c602587d13d88d0197830d"
Aug 04 00:56:28.701282 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:56:28.701242    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"203407977fab6fcba732cb0afe6ebde1e3b4f17480c602587d13d88d0197830d\": container with ID starting with 203407977fab6fcba732cb0afe6ebde1e3b4f17480c602587d13d88d0197830d not found: ID does not exist" containerID="203407977fab6fcba732cb0afe6ebde1e3b4f17480c602587d13d88d0197830d"
Aug 04 00:56:28.701396 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.701291    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"203407977fab6fcba732cb0afe6ebde1e3b4f17480c602587d13d88d0197830d"} err="failed to get container status \"203407977fab6fcba732cb0afe6ebde1e3b4f17480c602587d13d88d0197830d\": rpc error: code = NotFound desc = could not find container \"203407977fab6fcba732cb0afe6ebde1e3b4f17480c602587d13d88d0197830d\": container with ID starting with 203407977fab6fcba732cb0afe6ebde1e3b4f17480c602587d13d88d0197830d not found: ID does not exist"
Aug 04 00:56:28.701396 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.701315    2556 scope.go:117] "RemoveContainer" containerID="1f41dc365623b36be3cf81374fadd55ea82b320ac9c3c771dfa1e788905c9046"
Aug 04 00:56:28.707214 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.707184    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"]
Aug 04 00:56:28.713100 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.713075    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a5b2e0/rate-test-model-a5b2e0-kserve-7b7fb696f9-dfrsw"]
Aug 04 00:56:28.752326 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.752294    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56m2w\" (UniqueName: \"kubernetes.io/projected/79b19b37-6ced-4a32-b1ee-6add3d57220e-kube-api-access-56m2w\") pod \"79b19b37-6ced-4a32-b1ee-6add3d57220e\" (UID: \"79b19b37-6ced-4a32-b1ee-6add3d57220e\") "
Aug 04 00:56:28.752564 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.752364    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79b19b37-6ced-4a32-b1ee-6add3d57220e-dshm\") pod \"79b19b37-6ced-4a32-b1ee-6add3d57220e\" (UID: \"79b19b37-6ced-4a32-b1ee-6add3d57220e\") "
Aug 04 00:56:28.752564 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.752407    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79b19b37-6ced-4a32-b1ee-6add3d57220e-model-cache\") pod \"79b19b37-6ced-4a32-b1ee-6add3d57220e\" (UID: \"79b19b37-6ced-4a32-b1ee-6add3d57220e\") "
Aug 04 00:56:28.752564 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.752462    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79b19b37-6ced-4a32-b1ee-6add3d57220e-tmp-dir\") pod \"79b19b37-6ced-4a32-b1ee-6add3d57220e\" (UID: \"79b19b37-6ced-4a32-b1ee-6add3d57220e\") "
Aug 04 00:56:28.752564 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.752479    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79b19b37-6ced-4a32-b1ee-6add3d57220e-home\") pod \"79b19b37-6ced-4a32-b1ee-6add3d57220e\" (UID: \"79b19b37-6ced-4a32-b1ee-6add3d57220e\") "
Aug 04 00:56:28.752564 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.752494    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79b19b37-6ced-4a32-b1ee-6add3d57220e-tls-certs\") pod \"79b19b37-6ced-4a32-b1ee-6add3d57220e\" (UID: \"79b19b37-6ced-4a32-b1ee-6add3d57220e\") "
Aug 04 00:56:28.752895 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.752750    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79b19b37-6ced-4a32-b1ee-6add3d57220e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "79b19b37-6ced-4a32-b1ee-6add3d57220e" (UID: "79b19b37-6ced-4a32-b1ee-6add3d57220e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:56:28.752895 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.752799    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79b19b37-6ced-4a32-b1ee-6add3d57220e-home" (OuterVolumeSpecName: "home") pod "79b19b37-6ced-4a32-b1ee-6add3d57220e" (UID: "79b19b37-6ced-4a32-b1ee-6add3d57220e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:56:28.752895 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.752806    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79b19b37-6ced-4a32-b1ee-6add3d57220e-model-cache" (OuterVolumeSpecName: "model-cache") pod "79b19b37-6ced-4a32-b1ee-6add3d57220e" (UID: "79b19b37-6ced-4a32-b1ee-6add3d57220e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:56:28.754643 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.754610    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79b19b37-6ced-4a32-b1ee-6add3d57220e-dshm" (OuterVolumeSpecName: "dshm") pod "79b19b37-6ced-4a32-b1ee-6add3d57220e" (UID: "79b19b37-6ced-4a32-b1ee-6add3d57220e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:56:28.754789 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.754681    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79b19b37-6ced-4a32-b1ee-6add3d57220e-kube-api-access-56m2w" (OuterVolumeSpecName: "kube-api-access-56m2w") pod "79b19b37-6ced-4a32-b1ee-6add3d57220e" (UID: "79b19b37-6ced-4a32-b1ee-6add3d57220e"). InnerVolumeSpecName "kube-api-access-56m2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:56:28.754789 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.754682    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79b19b37-6ced-4a32-b1ee-6add3d57220e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "79b19b37-6ced-4a32-b1ee-6add3d57220e" (UID: "79b19b37-6ced-4a32-b1ee-6add3d57220e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:56:28.853570 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.853470    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56m2w\" (UniqueName: \"kubernetes.io/projected/79b19b37-6ced-4a32-b1ee-6add3d57220e-kube-api-access-56m2w\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:56:28.853570 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.853504    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79b19b37-6ced-4a32-b1ee-6add3d57220e-dshm\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:56:28.853570 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.853514    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79b19b37-6ced-4a32-b1ee-6add3d57220e-model-cache\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:56:28.853570 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.853523    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79b19b37-6ced-4a32-b1ee-6add3d57220e-tmp-dir\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:56:28.853570 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.853530    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79b19b37-6ced-4a32-b1ee-6add3d57220e-home\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:56:28.853570 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:28.853538    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79b19b37-6ced-4a32-b1ee-6add3d57220e-tls-certs\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:56:29.012427 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:29.012397    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"]
Aug 04 00:56:29.015738 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:29.015688    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-5396f3/rate-test-model-5396f3-kserve-6b85b7bf99-xbmbt"]
Aug 04 00:56:29.416068 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:29.416027    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7369-140579950801232"]
Aug 04 00:56:29.416451 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:29.416438    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3d5f8d1-992d-43b5-bcb5-941645e7311e" containerName="main"
Aug 04 00:56:29.416499 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:29.416452    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3d5f8d1-992d-43b5-bcb5-941645e7311e" containerName="main"
Aug 04 00:56:29.416499 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:29.416482    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79b19b37-6ced-4a32-b1ee-6add3d57220e" containerName="main"
Aug 04 00:56:29.416499 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:29.416487    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="79b19b37-6ced-4a32-b1ee-6add3d57220e" containerName="main"
Aug 04 00:56:29.416596 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:29.416543    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="79b19b37-6ced-4a32-b1ee-6add3d57220e" containerName="main"
Aug 04 00:56:29.416596 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:29.416557    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3d5f8d1-992d-43b5-bcb5-941645e7311e" containerName="main"
Aug 04 00:56:29.421308 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:29.421271    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7369-140579950801232"
Aug 04 00:56:29.423398 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:29.423374    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7369-140579950801232"]
Aug 04 00:56:29.423586 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:29.423568    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-s7lgt\""
Aug 04 00:56:29.459819 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:29.459778    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tcb5\" (UniqueName: \"kubernetes.io/projected/6ac42740-583c-4865-9f79-4cc88334e38d-kube-api-access-7tcb5\") pod \"test-curl-7369-140579950801232\" (UID: \"6ac42740-583c-4865-9f79-4cc88334e38d\") " pod="opendatahub/test-curl-7369-140579950801232"
Aug 04 00:56:29.560951 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:29.560900    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tcb5\" (UniqueName: \"kubernetes.io/projected/6ac42740-583c-4865-9f79-4cc88334e38d-kube-api-access-7tcb5\") pod \"test-curl-7369-140579950801232\" (UID: \"6ac42740-583c-4865-9f79-4cc88334e38d\") " pod="opendatahub/test-curl-7369-140579950801232"
Aug 04 00:56:29.569429 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:29.569395    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tcb5\" (UniqueName: \"kubernetes.io/projected/6ac42740-583c-4865-9f79-4cc88334e38d-kube-api-access-7tcb5\") pod \"test-curl-7369-140579950801232\" (UID: \"6ac42740-583c-4865-9f79-4cc88334e38d\") " pod="opendatahub/test-curl-7369-140579950801232"
Aug 04 00:56:29.731939 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:29.731840    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7369-140579950801232"
Aug 04 00:56:29.875964 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:29.875936    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7369-140579950801232"]
Aug 04 00:56:29.878254 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:56:29.878223    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ac42740_583c_4865_9f79_4cc88334e38d.slice/crio-dc5901ed757d54b4f5510ceb1ec42ff8ce77f44a9281e91b912851a56a1a8ee4 WatchSource:0}: Error finding container dc5901ed757d54b4f5510ceb1ec42ff8ce77f44a9281e91b912851a56a1a8ee4: Status 404 returned error can't find the container with id dc5901ed757d54b4f5510ceb1ec42ff8ce77f44a9281e91b912851a56a1a8ee4
Aug 04 00:56:29.879640 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:29.879621    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 00:56:30.307789 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:30.307756    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79b19b37-6ced-4a32-b1ee-6add3d57220e" path="/var/lib/kubelet/pods/79b19b37-6ced-4a32-b1ee-6add3d57220e/volumes"
Aug 04 00:56:30.308245 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:30.308227    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3d5f8d1-992d-43b5-bcb5-941645e7311e" path="/var/lib/kubelet/pods/d3d5f8d1-992d-43b5-bcb5-941645e7311e/volumes"
Aug 04 00:56:30.705478 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:30.705447    2556 generic.go:356] "Generic (PLEG): container finished" podID="6ac42740-583c-4865-9f79-4cc88334e38d" containerID="cfb37e7329aae3ecc29570d9f4a32466e3d1be5713e7ec7ab3418f4cf768f7b0" exitCode=0
Aug 04 00:56:30.705657 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:30.705531    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7369-140579950801232" event={"ID":"6ac42740-583c-4865-9f79-4cc88334e38d","Type":"ContainerDied","Data":"cfb37e7329aae3ecc29570d9f4a32466e3d1be5713e7ec7ab3418f4cf768f7b0"}
Aug 04 00:56:30.705657 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:30.705576    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7369-140579950801232" event={"ID":"6ac42740-583c-4865-9f79-4cc88334e38d","Type":"ContainerStarted","Data":"dc5901ed757d54b4f5510ceb1ec42ff8ce77f44a9281e91b912851a56a1a8ee4"}
Aug 04 00:56:31.852524 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:31.852499    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7369-140579950801232"
Aug 04 00:56:31.883233 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:31.883195    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tcb5\" (UniqueName: \"kubernetes.io/projected/6ac42740-583c-4865-9f79-4cc88334e38d-kube-api-access-7tcb5\") pod \"6ac42740-583c-4865-9f79-4cc88334e38d\" (UID: \"6ac42740-583c-4865-9f79-4cc88334e38d\") "
Aug 04 00:56:31.885422 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:31.885389    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ac42740-583c-4865-9f79-4cc88334e38d-kube-api-access-7tcb5" (OuterVolumeSpecName: "kube-api-access-7tcb5") pod "6ac42740-583c-4865-9f79-4cc88334e38d" (UID: "6ac42740-583c-4865-9f79-4cc88334e38d"). InnerVolumeSpecName "kube-api-access-7tcb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:56:31.888101 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:31.888072    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7369-140579950801232_6ac42740-583c-4865-9f79-4cc88334e38d/test-curl-7369-140579950801232/0.log"
Aug 04 00:56:31.909988 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:31.909953    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7369-140579950801232"]
Aug 04 00:56:31.918521 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:31.916350    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7369-140579950801232"]
Aug 04 00:56:31.984821 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:31.984700    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tcb5\" (UniqueName: \"kubernetes.io/projected/6ac42740-583c-4865-9f79-4cc88334e38d-kube-api-access-7tcb5\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:56:32.307727 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.307679    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ac42740-583c-4865-9f79-4cc88334e38d" path="/var/lib/kubelet/pods/6ac42740-583c-4865-9f79-4cc88334e38d/volumes"
Aug 04 00:56:32.667819 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.667737    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"]
Aug 04 00:56:32.668493 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.668469    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ac42740-583c-4865-9f79-4cc88334e38d" containerName="test-curl-7369-140579950801232"
Aug 04 00:56:32.668493 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.668491    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ac42740-583c-4865-9f79-4cc88334e38d" containerName="test-curl-7369-140579950801232"
Aug 04 00:56:32.668659 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.668576    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ac42740-583c-4865-9f79-4cc88334e38d" containerName="test-curl-7369-140579950801232"
Aug 04 00:56:32.671994 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.671975    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.674670 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.674649    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-579628-openshift-default-dockercfg-5hqbj\""
Aug 04 00:56:32.685705 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.685671    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"]
Aug 04 00:56:32.717084 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.717055    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7369-140579950801232"
Aug 04 00:56:32.717283 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.717116    2556 scope.go:117] "RemoveContainer" containerID="cfb37e7329aae3ecc29570d9f4a32466e3d1be5713e7ec7ab3418f4cf768f7b0"
Aug 04 00:56:32.793516 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.793478    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-istio-envoy\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.793696 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.793538    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65a50f1b-c1e7-4942-a597-ee271fa76f16-istio-token\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.793696 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.793613    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65a50f1b-c1e7-4942-a597-ee271fa76f16-istiod-ca-cert\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.793696 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.793655    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-credential-socket\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.793696 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.793678    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9bw2\" (UniqueName: \"kubernetes.io/projected/65a50f1b-c1e7-4942-a597-ee271fa76f16-kube-api-access-q9bw2\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.793927 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.793744    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-istio-data\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.793927 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.793767    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-workload-socket\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.793927 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.793804    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65a50f1b-c1e7-4942-a597-ee271fa76f16-istio-podinfo\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.793927 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.793870    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-workload-certs\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.895379 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.895343    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-istio-envoy\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.895870 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.895389    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65a50f1b-c1e7-4942-a597-ee271fa76f16-istio-token\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.895870 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.895409    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65a50f1b-c1e7-4942-a597-ee271fa76f16-istiod-ca-cert\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.895870 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.895525    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-credential-socket\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.895870 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.895567    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9bw2\" (UniqueName: \"kubernetes.io/projected/65a50f1b-c1e7-4942-a597-ee271fa76f16-kube-api-access-q9bw2\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.895870 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.895606    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-istio-data\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.895870 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.895638    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-workload-socket\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.895870 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.895823    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65a50f1b-c1e7-4942-a597-ee271fa76f16-istio-podinfo\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.896273 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.895931    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-workload-certs\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.896273 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.895957    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-credential-socket\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.896273 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.895995    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-workload-socket\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.896273 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.896061    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-istio-data\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.896273 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.896190    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-workload-certs\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.896273 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.896192    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65a50f1b-c1e7-4942-a597-ee271fa76f16-istiod-ca-cert\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.897921 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.897898    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-istio-envoy\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.898285 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.898261    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65a50f1b-c1e7-4942-a597-ee271fa76f16-istio-podinfo\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.909352 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.909325    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65a50f1b-c1e7-4942-a597-ee271fa76f16-istio-token\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.909453 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.909354    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9bw2\" (UniqueName: \"kubernetes.io/projected/65a50f1b-c1e7-4942-a597-ee271fa76f16-kube-api-access-q9bw2\") pod \"e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") " pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:32.982296 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:32.982206    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:33.145063 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:33.145032    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"]
Aug 04 00:56:33.147674 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:56:33.147640    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65a50f1b_c1e7_4942_a597_ee271fa76f16.slice/crio-733e426fb545d9d272b410c70d2e487168e9a6e897e50f44216112a35cd9a57d WatchSource:0}: Error finding container 733e426fb545d9d272b410c70d2e487168e9a6e897e50f44216112a35cd9a57d: Status 404 returned error can't find the container with id 733e426fb545d9d272b410c70d2e487168e9a6e897e50f44216112a35cd9a57d
Aug 04 00:56:33.150130 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:33.150085    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:56:33.150225 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:33.150184    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:56:33.150268 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:33.150229    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:56:33.725037 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:33.724996    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb" event={"ID":"65a50f1b-c1e7-4942-a597-ee271fa76f16","Type":"ContainerStarted","Data":"45b1edb55c667e6482aa21afac31b57c6fc848318e092004bc5556707c586236"}
Aug 04 00:56:33.725359 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:33.725063    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb" event={"ID":"65a50f1b-c1e7-4942-a597-ee271fa76f16","Type":"ContainerStarted","Data":"733e426fb545d9d272b410c70d2e487168e9a6e897e50f44216112a35cd9a57d"}
Aug 04 00:56:33.746366 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:33.746310    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb" podStartSLOduration=1.746293787 podStartE2EDuration="1.746293787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:56:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:56:33.744886291 +0000 UTC m=+3247.913523672" watchObservedRunningTime="2026-08-04 00:56:33.746293787 +0000 UTC m=+3247.914931156"
Aug 04 00:56:33.982668 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:33.982580    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:34.988010 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:34.987980    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:35.736669 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:35.736636    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:35.737631 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:35.737603    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:50.738690 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:50.738649    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Aug 04 00:56:50.739145 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:50.738741    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb" podUID="65a50f1b-c1e7-4942-a597-ee271fa76f16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Aug 04 00:56:50.819674 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:50.819641    2556 generic.go:356] "Generic (PLEG): container finished" podID="65a50f1b-c1e7-4942-a597-ee271fa76f16" containerID="45b1edb55c667e6482aa21afac31b57c6fc848318e092004bc5556707c586236" exitCode=0
Aug 04 00:56:50.819863 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:50.819738    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb" event={"ID":"65a50f1b-c1e7-4942-a597-ee271fa76f16","Type":"ContainerDied","Data":"45b1edb55c667e6482aa21afac31b57c6fc848318e092004bc5556707c586236"}
Aug 04 00:56:50.820187 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:50.820170    2556 scope.go:117] "RemoveContainer" containerID="45b1edb55c667e6482aa21afac31b57c6fc848318e092004bc5556707c586236"
Aug 04 00:56:50.821245 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:50.821205    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:56:50.821337 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:50.821287    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:56:50.821393 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:50.821355    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:56:51.830119 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:51.830079    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb" event={"ID":"65a50f1b-c1e7-4942-a597-ee271fa76f16","Type":"ContainerStarted","Data":"3afe943f6253befea5e2bf84edee16c477536d0c5e9f596964db0d29b9066902"}
Aug 04 00:56:51.983274 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:51.983230    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:51.983470 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:51.983446    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Aug 04 00:56:51.983518 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:51.983497    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb" podUID="65a50f1b-c1e7-4942-a597-ee271fa76f16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Aug 04 00:56:52.983058 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:52.983024    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Aug 04 00:56:52.983470 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:52.983081    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb" podUID="65a50f1b-c1e7-4942-a597-ee271fa76f16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Aug 04 00:56:53.983302 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:53.983263    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Aug 04 00:56:53.983708 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:53.983328    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb" podUID="65a50f1b-c1e7-4942-a597-ee271fa76f16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Aug 04 00:56:54.983619 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:54.983576    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Aug 04 00:56:54.984034 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:54.983643    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb" podUID="65a50f1b-c1e7-4942-a597-ee271fa76f16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Aug 04 00:56:55.982680 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:55.982638    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Aug 04 00:56:55.982904 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:55.982705    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb" podUID="65a50f1b-c1e7-4942-a597-ee271fa76f16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Aug 04 00:56:56.983040 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:56.982991    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Aug 04 00:56:56.983551 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:56.983052    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb" podUID="65a50f1b-c1e7-4942-a597-ee271fa76f16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Aug 04 00:56:57.986869 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:57.986836    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:57.987327 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:57.987214    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:56:57.988024 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:56:57.988006    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 00:57:01.547773 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.547736    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"]
Aug 04 00:57:01.551124 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.551101    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.553592 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.553574    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-f277ac-openshift-default-dockercfg-4lbpj\""
Aug 04 00:57:01.563857 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.563828    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"]
Aug 04 00:57:01.590611 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.590572    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istiod-ca-cert\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.590851 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.590624    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-workload-certs\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.590851 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.590703    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istio-podinfo\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.590851 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.590826    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-credential-socket\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.591047 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.590868    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istio-token\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.591047 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.590972    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-workload-socket\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.591047 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.591014    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istio-data\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.591047 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.591042    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nh4k\" (UniqueName: \"kubernetes.io/projected/823eee5a-32b0-4676-a85d-eeaf20cfdda9-kube-api-access-2nh4k\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.591218 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.591070    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istio-envoy\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.691948 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.691904    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istio-podinfo\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.691948 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.691952    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-credential-socket\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.692227 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.691980    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istio-token\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.692227 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.692043    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-workload-socket\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.692227 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.692075    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istio-data\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.692227 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.692105    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nh4k\" (UniqueName: \"kubernetes.io/projected/823eee5a-32b0-4676-a85d-eeaf20cfdda9-kube-api-access-2nh4k\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.692227 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.692134    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istio-envoy\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.692227 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.692180    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istiod-ca-cert\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.692227 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.692221    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-workload-certs\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.692593 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.692421    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-credential-socket\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.692593 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.692476    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-workload-socket\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.692593 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.692551    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istio-data\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.692738 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.692649    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-workload-certs\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.693027 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.693007    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istiod-ca-cert\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.694500 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.694481    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istio-envoy\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.694838 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.694815    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istio-podinfo\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.700035 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.700002    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istio-token\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.700173 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.700066    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nh4k\" (UniqueName: \"kubernetes.io/projected/823eee5a-32b0-4676-a85d-eeaf20cfdda9-kube-api-access-2nh4k\") pod \"e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") " pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:01.863047 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:01.862954    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:02.016758 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:02.016688    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"]
Aug 04 00:57:02.018774 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:57:02.018742    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod823eee5a_32b0_4676_a85d_eeaf20cfdda9.slice/crio-1981c15630a3e55cd41f2dde418d9043bf352d1ea04de9c6fa55883adc430e0e WatchSource:0}: Error finding container 1981c15630a3e55cd41f2dde418d9043bf352d1ea04de9c6fa55883adc430e0e: Status 404 returned error can't find the container with id 1981c15630a3e55cd41f2dde418d9043bf352d1ea04de9c6fa55883adc430e0e
Aug 04 00:57:02.021469 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:02.021432    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:57:02.021563 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:02.021501    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:57:02.021563 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:02.021544    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:57:02.901114 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:02.901075    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7" event={"ID":"823eee5a-32b0-4676-a85d-eeaf20cfdda9","Type":"ContainerStarted","Data":"16fcf8977faa08e247dee6b8a7fec43cf6ca4140bcbf0bdf7aa269223b9feb0f"}
Aug 04 00:57:02.901611 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:02.901133    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7" event={"ID":"823eee5a-32b0-4676-a85d-eeaf20cfdda9","Type":"ContainerStarted","Data":"1981c15630a3e55cd41f2dde418d9043bf352d1ea04de9c6fa55883adc430e0e"}
Aug 04 00:57:02.941535 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:02.941475    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7" podStartSLOduration=1.941458537 podStartE2EDuration="1.941458537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:57:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:57:02.941016625 +0000 UTC m=+3277.109654021" watchObservedRunningTime="2026-08-04 00:57:02.941458537 +0000 UTC m=+3277.110095907"
Aug 04 00:57:03.863623 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:03.863585    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:03.868788 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:03.868758    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:03.906261 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:03.906227    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:03.907200 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:03.907180    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:18.907778 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:18.907744    2556 patch_prober.go:28] interesting pod/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Aug 04 00:57:18.908284 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:18.907814    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7" podUID="823eee5a-32b0-4676-a85d-eeaf20cfdda9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Aug 04 00:57:19.010044 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:19.010008    2556 generic.go:356] "Generic (PLEG): container finished" podID="823eee5a-32b0-4676-a85d-eeaf20cfdda9" containerID="16fcf8977faa08e247dee6b8a7fec43cf6ca4140bcbf0bdf7aa269223b9feb0f" exitCode=0
Aug 04 00:57:19.010223 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:19.010083    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7" event={"ID":"823eee5a-32b0-4676-a85d-eeaf20cfdda9","Type":"ContainerDied","Data":"16fcf8977faa08e247dee6b8a7fec43cf6ca4140bcbf0bdf7aa269223b9feb0f"}
Aug 04 00:57:19.010541 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:19.010527    2556 scope.go:117] "RemoveContainer" containerID="16fcf8977faa08e247dee6b8a7fec43cf6ca4140bcbf0bdf7aa269223b9feb0f"
Aug 04 00:57:19.011786 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:19.011704    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:57:19.011848 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:19.011800    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:57:19.011848 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:19.011835    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 00:57:20.017964 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:20.017930    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7" event={"ID":"823eee5a-32b0-4676-a85d-eeaf20cfdda9","Type":"ContainerStarted","Data":"fb2dada62f5ba03ff4f82a27a549122e134581a8f16875fe73aa3cade355e8ff"}
Aug 04 00:57:20.864284 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:20.864242    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:20.864503 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:20.864385    2556 patch_prober.go:28] interesting pod/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Aug 04 00:57:20.864503 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:20.864431    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7" podUID="823eee5a-32b0-4676-a85d-eeaf20cfdda9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Aug 04 00:57:21.863900 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:21.863853    2556 patch_prober.go:28] interesting pod/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Aug 04 00:57:21.864422 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:21.863925    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7" podUID="823eee5a-32b0-4676-a85d-eeaf20cfdda9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Aug 04 00:57:22.864192 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:22.864139    2556 patch_prober.go:28] interesting pod/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Aug 04 00:57:22.864735 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:22.864219    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7" podUID="823eee5a-32b0-4676-a85d-eeaf20cfdda9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Aug 04 00:57:23.864458 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:23.864412    2556 patch_prober.go:28] interesting pod/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Aug 04 00:57:23.864980 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:23.864500    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7" podUID="823eee5a-32b0-4676-a85d-eeaf20cfdda9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Aug 04 00:57:24.863446 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:24.863391    2556 patch_prober.go:28] interesting pod/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Aug 04 00:57:24.863673 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:24.863485    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7" podUID="823eee5a-32b0-4676-a85d-eeaf20cfdda9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Aug 04 00:57:25.868538 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:25.868503    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:25.869044 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:25.868951    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:25.869703 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:25.869683    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 00:57:26.528802 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:26.528769    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:57:26.538890 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:26.538862    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mbxb_c7e62961-9c80-467c-b7ea-0ddd6bcec813/ovn-acl-logging/0.log"
Aug 04 00:57:53.406218 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.406119    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"]
Aug 04 00:57:53.408903 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.408885    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:57:53.412987 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.412953    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-579628\"/\"ipp-route-579628-kserve-self-signed-certs\""
Aug 04 00:57:53.412987 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.412953    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-579628\"/\"openshift-service-ca.crt\""
Aug 04 00:57:53.413193 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.412999    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-579628\"/\"kube-root-ca.crt\""
Aug 04 00:57:53.413193 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.413020    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-579628\"/\"default-dockercfg-485qp\""
Aug 04 00:57:53.420737 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.420697    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"]
Aug 04 00:57:53.522481 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.522440    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-tmp-dir\") pod \"ipp-route-579628-kserve-7589ccf6c5-jxn4b\" (UID: \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\") " pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:57:53.522745 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.522510    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-dshm\") pod \"ipp-route-579628-kserve-7589ccf6c5-jxn4b\" (UID: \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\") " pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:57:53.522745 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.522582    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-model-cache\") pod \"ipp-route-579628-kserve-7589ccf6c5-jxn4b\" (UID: \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\") " pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:57:53.522745 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.522651    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-tls-certs\") pod \"ipp-route-579628-kserve-7589ccf6c5-jxn4b\" (UID: \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\") " pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:57:53.522942 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.522775    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz974\" (UniqueName: \"kubernetes.io/projected/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-kube-api-access-cz974\") pod \"ipp-route-579628-kserve-7589ccf6c5-jxn4b\" (UID: \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\") " pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:57:53.522942 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.522813    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-home\") pod \"ipp-route-579628-kserve-7589ccf6c5-jxn4b\" (UID: \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\") " pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:57:53.623536 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.623498    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-tmp-dir\") pod \"ipp-route-579628-kserve-7589ccf6c5-jxn4b\" (UID: \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\") " pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:57:53.623536 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.623543    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-dshm\") pod \"ipp-route-579628-kserve-7589ccf6c5-jxn4b\" (UID: \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\") " pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:57:53.623859 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.623583    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-model-cache\") pod \"ipp-route-579628-kserve-7589ccf6c5-jxn4b\" (UID: \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\") " pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:57:53.623859 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.623602    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-tls-certs\") pod \"ipp-route-579628-kserve-7589ccf6c5-jxn4b\" (UID: \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\") " pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:57:53.623859 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.623767    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz974\" (UniqueName: \"kubernetes.io/projected/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-kube-api-access-cz974\") pod \"ipp-route-579628-kserve-7589ccf6c5-jxn4b\" (UID: \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\") " pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:57:53.623859 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.623829    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-home\") pod \"ipp-route-579628-kserve-7589ccf6c5-jxn4b\" (UID: \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\") " pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:57:53.624090 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.624070    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-tmp-dir\") pod \"ipp-route-579628-kserve-7589ccf6c5-jxn4b\" (UID: \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\") " pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:57:53.624158 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.624090    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-model-cache\") pod \"ipp-route-579628-kserve-7589ccf6c5-jxn4b\" (UID: \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\") " pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:57:53.624212 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.624176    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-home\") pod \"ipp-route-579628-kserve-7589ccf6c5-jxn4b\" (UID: \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\") " pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:57:53.625883 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.625861    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-dshm\") pod \"ipp-route-579628-kserve-7589ccf6c5-jxn4b\" (UID: \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\") " pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:57:53.626263 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.626242    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-tls-certs\") pod \"ipp-route-579628-kserve-7589ccf6c5-jxn4b\" (UID: \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\") " pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:57:53.631657 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.631627    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz974\" (UniqueName: \"kubernetes.io/projected/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-kube-api-access-cz974\") pod \"ipp-route-579628-kserve-7589ccf6c5-jxn4b\" (UID: \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\") " pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:57:53.721086 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.720978    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:57:53.868188 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:53.868159    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"]
Aug 04 00:57:53.870364 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:57:53.870337    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7fbbf3ca_6bed_414a_a853_67e2aca5dc5a.slice/crio-8ee710a37c6cf9ce243c42a04857afa835de34e89b59e8f94af2e50480c1100b WatchSource:0}: Error finding container 8ee710a37c6cf9ce243c42a04857afa835de34e89b59e8f94af2e50480c1100b: Status 404 returned error can't find the container with id 8ee710a37c6cf9ce243c42a04857afa835de34e89b59e8f94af2e50480c1100b
Aug 04 00:57:54.203948 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:54.203909    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b" event={"ID":"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a","Type":"ContainerStarted","Data":"68243467ae3c0474dcdf4085134090781386f6f001ca913c528aa4128fdf120e"}
Aug 04 00:57:54.203948 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:54.203953    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b" event={"ID":"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a","Type":"ContainerStarted","Data":"8ee710a37c6cf9ce243c42a04857afa835de34e89b59e8f94af2e50480c1100b"}
Aug 04 00:57:54.222092 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:57:54.222039    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b" podStartSLOduration=1.222022937 podStartE2EDuration="1.222022937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:57:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:57:54.220097854 +0000 UTC m=+3328.388735223" watchObservedRunningTime="2026-08-04 00:57:54.222022937 +0000 UTC m=+3328.390660306"
Aug 04 00:58:03.721564 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:58:03.721523    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:58:03.722106 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:58:03.721631    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:58:03.734259 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:58:03.734232    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:58:04.268386 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:58:04.268350    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:59:01.341361 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:01.341325    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-974a1b-gvvxg"]
Aug 04 00:59:01.344335 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:01.344308    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-974a1b-gvvxg"
Aug 04 00:59:01.346961 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:01.346938    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8db7m\""
Aug 04 00:59:01.352535 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:01.352512    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-974a1b-gvvxg"]
Aug 04 00:59:01.413503 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:01.413465    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0567805-e89d-42ac-a6cd-609ec6cdb708-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-974a1b-gvvxg\" (UID: \"e0567805-e89d-42ac-a6cd-609ec6cdb708\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-974a1b-gvvxg"
Aug 04 00:59:01.514334 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:01.514296    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0567805-e89d-42ac-a6cd-609ec6cdb708-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-974a1b-gvvxg\" (UID: \"e0567805-e89d-42ac-a6cd-609ec6cdb708\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-974a1b-gvvxg"
Aug 04 00:59:01.514972 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:01.514951    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0567805-e89d-42ac-a6cd-609ec6cdb708-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-974a1b-gvvxg\" (UID: \"e0567805-e89d-42ac-a6cd-609ec6cdb708\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-974a1b-gvvxg"
Aug 04 00:59:01.656938 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:01.656847    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-974a1b-gvvxg"
Aug 04 00:59:02.007119 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:02.007091    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-974a1b-gvvxg"]
Aug 04 00:59:02.009024 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:59:02.008993    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0567805_e89d_42ac_a6cd_609ec6cdb708.slice/crio-7d218511fd440d810a8c9e41c17e64e3c6a499dafba4bb78704715ad12915755 WatchSource:0}: Error finding container 7d218511fd440d810a8c9e41c17e64e3c6a499dafba4bb78704715ad12915755: Status 404 returned error can't find the container with id 7d218511fd440d810a8c9e41c17e64e3c6a499dafba4bb78704715ad12915755
Aug 04 00:59:02.570109 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:02.570013    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-974a1b-gvvxg" event={"ID":"e0567805-e89d-42ac-a6cd-609ec6cdb708","Type":"ContainerStarted","Data":"e91dd3eafc335c8f2d7480af606758ea963777b02348e064de79041aaa575410"}
Aug 04 00:59:02.570109 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:02.570070    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-974a1b-gvvxg" event={"ID":"e0567805-e89d-42ac-a6cd-609ec6cdb708","Type":"ContainerStarted","Data":"7d218511fd440d810a8c9e41c17e64e3c6a499dafba4bb78704715ad12915755"}
Aug 04 00:59:02.584789 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:02.584735    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-974a1b-gvvxg" podStartSLOduration=1.5847030659999999 podStartE2EDuration="1.584703066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 00:59:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 00:59:02.582948123 +0000 UTC m=+3396.751585519" watchObservedRunningTime="2026-08-04 00:59:02.584703066 +0000 UTC m=+3396.753340435"
Aug 04 00:59:03.576306 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:03.576272    2556 generic.go:356] "Generic (PLEG): container finished" podID="e0567805-e89d-42ac-a6cd-609ec6cdb708" containerID="e91dd3eafc335c8f2d7480af606758ea963777b02348e064de79041aaa575410" exitCode=0
Aug 04 00:59:03.576787 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:03.576355    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-974a1b-gvvxg" event={"ID":"e0567805-e89d-42ac-a6cd-609ec6cdb708","Type":"ContainerDied","Data":"e91dd3eafc335c8f2d7480af606758ea963777b02348e064de79041aaa575410"}
Aug 04 00:59:04.724247 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:04.724222    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-974a1b-gvvxg"
Aug 04 00:59:04.847351 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:04.847255    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0567805-e89d-42ac-a6cd-609ec6cdb708-maas-api-service-ca\") pod \"e0567805-e89d-42ac-a6cd-609ec6cdb708\" (UID: \"e0567805-e89d-42ac-a6cd-609ec6cdb708\") "
Aug 04 00:59:04.847683 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:04.847662    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0567805-e89d-42ac-a6cd-609ec6cdb708-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e0567805-e89d-42ac-a6cd-609ec6cdb708" (UID: "e0567805-e89d-42ac-a6cd-609ec6cdb708"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:59:04.949114 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:04.949059    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0567805-e89d-42ac-a6cd-609ec6cdb708-maas-api-service-ca\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:59:05.587543 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:05.587511    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-974a1b-gvvxg"
Aug 04 00:59:05.587699 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:05.587517    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-974a1b-gvvxg" event={"ID":"e0567805-e89d-42ac-a6cd-609ec6cdb708","Type":"ContainerDied","Data":"7d218511fd440d810a8c9e41c17e64e3c6a499dafba4bb78704715ad12915755"}
Aug 04 00:59:05.587699 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:05.587636    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d218511fd440d810a8c9e41c17e64e3c6a499dafba4bb78704715ad12915755"
Aug 04 00:59:07.768554 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:07.768516    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-974a1b-gvvxg"]
Aug 04 00:59:07.773430 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:07.773399    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-974a1b-gvvxg"]
Aug 04 00:59:08.308160 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:08.308124    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0567805-e89d-42ac-a6cd-609ec6cdb708" path="/var/lib/kubelet/pods/e0567805-e89d-42ac-a6cd-609ec6cdb708/volumes"
Aug 04 00:59:17.436369 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:17.436332    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-579628-8pjpd"]
Aug 04 00:59:17.436795 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:17.436781    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0567805-e89d-42ac-a6cd-609ec6cdb708" containerName="revoke-keys"
Aug 04 00:59:17.436852 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:17.436797    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0567805-e89d-42ac-a6cd-609ec6cdb708" containerName="revoke-keys"
Aug 04 00:59:17.436889 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:17.436872    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0567805-e89d-42ac-a6cd-609ec6cdb708" containerName="revoke-keys"
Aug 04 00:59:17.439050 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:17.439030    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-579628-8pjpd"
Aug 04 00:59:17.441552 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:17.441527    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8db7m\""
Aug 04 00:59:17.447035 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:17.447006    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-579628-8pjpd"]
Aug 04 00:59:17.579976 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:17.579928    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b140c2-8a3f-483c-bf9f-75b693a916e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-579628-8pjpd\" (UID: \"d2b140c2-8a3f-483c-bf9f-75b693a916e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-579628-8pjpd"
Aug 04 00:59:17.680988 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:17.680942    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b140c2-8a3f-483c-bf9f-75b693a916e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-579628-8pjpd\" (UID: \"d2b140c2-8a3f-483c-bf9f-75b693a916e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-579628-8pjpd"
Aug 04 00:59:17.681600 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:17.681580    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b140c2-8a3f-483c-bf9f-75b693a916e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-579628-8pjpd\" (UID: \"d2b140c2-8a3f-483c-bf9f-75b693a916e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-579628-8pjpd"
Aug 04 00:59:17.751768 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:17.751648    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-579628-8pjpd"
Aug 04 00:59:17.891377 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:17.891348    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-579628-8pjpd"]
Aug 04 00:59:17.893516 ip-10-0-143-2 kubenswrapper[2556]: W0804 00:59:17.893488    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2b140c2_8a3f_483c_bf9f_75b693a916e4.slice/crio-1af879a0893055c6618a622a08ffe0c90b394465aa775a3035cb67430f4af8ba WatchSource:0}: Error finding container 1af879a0893055c6618a622a08ffe0c90b394465aa775a3035cb67430f4af8ba: Status 404 returned error can't find the container with id 1af879a0893055c6618a622a08ffe0c90b394465aa775a3035cb67430f4af8ba
Aug 04 00:59:18.656911 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:18.656880    2556 generic.go:356] "Generic (PLEG): container finished" podID="d2b140c2-8a3f-483c-bf9f-75b693a916e4" containerID="8988bccd439015a186854a7231d0b495d7321c534b05e148873166fff72d7a4b" exitCode=0
Aug 04 00:59:18.657343 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:18.656962    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-579628-8pjpd" event={"ID":"d2b140c2-8a3f-483c-bf9f-75b693a916e4","Type":"ContainerDied","Data":"8988bccd439015a186854a7231d0b495d7321c534b05e148873166fff72d7a4b"}
Aug 04 00:59:18.657343 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:18.657016    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-579628-8pjpd" event={"ID":"d2b140c2-8a3f-483c-bf9f-75b693a916e4","Type":"ContainerStarted","Data":"1af879a0893055c6618a622a08ffe0c90b394465aa775a3035cb67430f4af8ba"}
Aug 04 00:59:19.802552 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:19.802523    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-579628-8pjpd"
Aug 04 00:59:19.904856 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:19.904812    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b140c2-8a3f-483c-bf9f-75b693a916e4-maas-api-service-ca\") pod \"d2b140c2-8a3f-483c-bf9f-75b693a916e4\" (UID: \"d2b140c2-8a3f-483c-bf9f-75b693a916e4\") "
Aug 04 00:59:19.905213 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:19.905189    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2b140c2-8a3f-483c-bf9f-75b693a916e4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d2b140c2-8a3f-483c-bf9f-75b693a916e4" (UID: "d2b140c2-8a3f-483c-bf9f-75b693a916e4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 00:59:20.005954 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:20.005924    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b140c2-8a3f-483c-bf9f-75b693a916e4-maas-api-service-ca\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:59:20.676240 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:20.676156    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-579628-8pjpd"
Aug 04 00:59:20.676240 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:20.676173    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-579628-8pjpd" event={"ID":"d2b140c2-8a3f-483c-bf9f-75b693a916e4","Type":"ContainerDied","Data":"1af879a0893055c6618a622a08ffe0c90b394465aa775a3035cb67430f4af8ba"}
Aug 04 00:59:20.676240 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:20.676223    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1af879a0893055c6618a622a08ffe0c90b394465aa775a3035cb67430f4af8ba"
Aug 04 00:59:33.218807 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:33.218764    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-579628-8pjpd"]
Aug 04 00:59:33.220803 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:33.220777    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-579628-8pjpd"]
Aug 04 00:59:34.308341 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:34.308306    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2b140c2-8a3f-483c-bf9f-75b693a916e4" path="/var/lib/kubelet/pods/d2b140c2-8a3f-483c-bf9f-75b693a916e4/volumes"
Aug 04 00:59:38.556231 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:38.556193    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"]
Aug 04 00:59:53.576075 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:53.576028    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b" podUID="7fbbf3ca-6bed-414a-a853-67e2aca5dc5a" containerName="main" containerID="cri-o://68243467ae3c0474dcdf4085134090781386f6f001ca913c528aa4128fdf120e" gracePeriod=45
Aug 04 00:59:53.831972 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:53.831904    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:59:53.859846 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:53.859783    2556 generic.go:356] "Generic (PLEG): container finished" podID="7fbbf3ca-6bed-414a-a853-67e2aca5dc5a" containerID="68243467ae3c0474dcdf4085134090781386f6f001ca913c528aa4128fdf120e" exitCode=0
Aug 04 00:59:53.860036 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:53.859834    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b" event={"ID":"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a","Type":"ContainerDied","Data":"68243467ae3c0474dcdf4085134090781386f6f001ca913c528aa4128fdf120e"}
Aug 04 00:59:53.860036 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:53.859894    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b" event={"ID":"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a","Type":"ContainerDied","Data":"8ee710a37c6cf9ce243c42a04857afa835de34e89b59e8f94af2e50480c1100b"}
Aug 04 00:59:53.860036 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:53.859916    2556 scope.go:117] "RemoveContainer" containerID="68243467ae3c0474dcdf4085134090781386f6f001ca913c528aa4128fdf120e"
Aug 04 00:59:53.860036 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:53.859847    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"
Aug 04 00:59:53.871125 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:53.871096    2556 scope.go:117] "RemoveContainer" containerID="68243467ae3c0474dcdf4085134090781386f6f001ca913c528aa4128fdf120e"
Aug 04 00:59:53.871498 ip-10-0-143-2 kubenswrapper[2556]: E0804 00:59:53.871470    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68243467ae3c0474dcdf4085134090781386f6f001ca913c528aa4128fdf120e\": container with ID starting with 68243467ae3c0474dcdf4085134090781386f6f001ca913c528aa4128fdf120e not found: ID does not exist" containerID="68243467ae3c0474dcdf4085134090781386f6f001ca913c528aa4128fdf120e"
Aug 04 00:59:53.871598 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:53.871512    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68243467ae3c0474dcdf4085134090781386f6f001ca913c528aa4128fdf120e"} err="failed to get container status \"68243467ae3c0474dcdf4085134090781386f6f001ca913c528aa4128fdf120e\": rpc error: code = NotFound desc = could not find container \"68243467ae3c0474dcdf4085134090781386f6f001ca913c528aa4128fdf120e\": container with ID starting with 68243467ae3c0474dcdf4085134090781386f6f001ca913c528aa4128fdf120e not found: ID does not exist"
Aug 04 00:59:53.951804 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:53.951767    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-tmp-dir\") pod \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\" (UID: \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\") "
Aug 04 00:59:53.952013 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:53.951821    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-home\") pod \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\" (UID: \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\") "
Aug 04 00:59:53.952013 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:53.951871    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-tls-certs\") pod \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\" (UID: \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\") "
Aug 04 00:59:53.952013 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:53.951897    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-dshm\") pod \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\" (UID: \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\") "
Aug 04 00:59:53.952013 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:53.951948    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cz974\" (UniqueName: \"kubernetes.io/projected/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-kube-api-access-cz974\") pod \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\" (UID: \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\") "
Aug 04 00:59:53.952013 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:53.951987    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-model-cache\") pod \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\" (UID: \"7fbbf3ca-6bed-414a-a853-67e2aca5dc5a\") "
Aug 04 00:59:53.952289 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:53.952090    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7fbbf3ca-6bed-414a-a853-67e2aca5dc5a" (UID: "7fbbf3ca-6bed-414a-a853-67e2aca5dc5a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:59:53.952289 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:53.952133    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-home" (OuterVolumeSpecName: "home") pod "7fbbf3ca-6bed-414a-a853-67e2aca5dc5a" (UID: "7fbbf3ca-6bed-414a-a853-67e2aca5dc5a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:59:53.952289 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:53.952261    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-model-cache" (OuterVolumeSpecName: "model-cache") pod "7fbbf3ca-6bed-414a-a853-67e2aca5dc5a" (UID: "7fbbf3ca-6bed-414a-a853-67e2aca5dc5a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:59:53.952473 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:53.952455    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-tmp-dir\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:59:53.952534 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:53.952475    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-home\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:59:53.952534 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:53.952485    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-model-cache\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:59:53.954447 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:53.954320    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-dshm" (OuterVolumeSpecName: "dshm") pod "7fbbf3ca-6bed-414a-a853-67e2aca5dc5a" (UID: "7fbbf3ca-6bed-414a-a853-67e2aca5dc5a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 00:59:53.954447 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:53.954343    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7fbbf3ca-6bed-414a-a853-67e2aca5dc5a" (UID: "7fbbf3ca-6bed-414a-a853-67e2aca5dc5a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 00:59:53.954447 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:53.954418    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-kube-api-access-cz974" (OuterVolumeSpecName: "kube-api-access-cz974") pod "7fbbf3ca-6bed-414a-a853-67e2aca5dc5a" (UID: "7fbbf3ca-6bed-414a-a853-67e2aca5dc5a"). InnerVolumeSpecName "kube-api-access-cz974". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 00:59:54.053268 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:54.053225    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-tls-certs\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:59:54.053268 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:54.053261    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-dshm\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:59:54.053268 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:54.053270    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cz974\" (UniqueName: \"kubernetes.io/projected/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a-kube-api-access-cz974\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 00:59:54.182026 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:54.181989    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"]
Aug 04 00:59:54.185533 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:54.185503    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-579628/ipp-route-579628-kserve-7589ccf6c5-jxn4b"]
Aug 04 00:59:54.308413 ip-10-0-143-2 kubenswrapper[2556]: I0804 00:59:54.308376    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fbbf3ca-6bed-414a-a853-67e2aca5dc5a" path="/var/lib/kubelet/pods/7fbbf3ca-6bed-414a-a853-67e2aca5dc5a/volumes"
Aug 04 01:00:00.168380 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:00.168344    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a5b2e0-29763420-kcxnh"]
Aug 04 01:00:00.168969 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:00.168949    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fbbf3ca-6bed-414a-a853-67e2aca5dc5a" containerName="main"
Aug 04 01:00:00.169058 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:00.168972    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fbbf3ca-6bed-414a-a853-67e2aca5dc5a" containerName="main"
Aug 04 01:00:00.169058 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:00.169022    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2b140c2-8a3f-483c-bf9f-75b693a916e4" containerName="revoke-keys"
Aug 04 01:00:00.169058 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:00.169032    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2b140c2-8a3f-483c-bf9f-75b693a916e4" containerName="revoke-keys"
Aug 04 01:00:00.169221 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:00.169129    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2b140c2-8a3f-483c-bf9f-75b693a916e4" containerName="revoke-keys"
Aug 04 01:00:00.169221 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:00.169143    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fbbf3ca-6bed-414a-a853-67e2aca5dc5a" containerName="main"
Aug 04 01:00:00.172517 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:00.172494    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a5b2e0-29763420-kcxnh"
Aug 04 01:00:00.178857 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:00.178831    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8db7m\""
Aug 04 01:00:00.183176 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:00.183150    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a5b2e0-29763420-kcxnh"
Aug 04 01:00:00.183413 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:00.183280    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a5b2e0-29763420-kcxnh"]
Aug 04 01:00:00.342345 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:00.342323    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a5b2e0-29763420-kcxnh"]
Aug 04 01:00:00.345117 ip-10-0-143-2 kubenswrapper[2556]: W0804 01:00:00.345085    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39557c08_0dd9_4d3b_9c13_14a8924cea02.slice/crio-d6ed5bb5297387203828d6d0bbfb8230829f703fb74729254b84fa20a61a0038 WatchSource:0}: Error finding container d6ed5bb5297387203828d6d0bbfb8230829f703fb74729254b84fa20a61a0038: Status 404 returned error can't find the container with id d6ed5bb5297387203828d6d0bbfb8230829f703fb74729254b84fa20a61a0038
Aug 04 01:00:00.901985 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:00.901887    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a5b2e0-29763420-kcxnh" event={"ID":"39557c08-0dd9-4d3b-9c13-14a8924cea02","Type":"ContainerStarted","Data":"951f6e2084092d06120e489f3309a85bcb83c5897db299c2af01f871b8f62ba3"}
Aug 04 01:00:00.901985 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:00.901940    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a5b2e0-29763420-kcxnh" event={"ID":"39557c08-0dd9-4d3b-9c13-14a8924cea02","Type":"ContainerStarted","Data":"d6ed5bb5297387203828d6d0bbfb8230829f703fb74729254b84fa20a61a0038"}
Aug 04 01:00:00.917808 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:00.917753    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a5b2e0-29763420-kcxnh" podStartSLOduration=0.917735076 podStartE2EDuration="917.735076ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 01:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 01:00:00.915471904 +0000 UTC m=+3455.084109276" watchObservedRunningTime="2026-08-04 01:00:00.917735076 +0000 UTC m=+3455.086372445"
Aug 04 01:00:01.909650 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:01.909607    2556 generic.go:356] "Generic (PLEG): container finished" podID="39557c08-0dd9-4d3b-9c13-14a8924cea02" containerID="951f6e2084092d06120e489f3309a85bcb83c5897db299c2af01f871b8f62ba3" exitCode=0
Aug 04 01:00:01.910145 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:01.909679    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a5b2e0-29763420-kcxnh" event={"ID":"39557c08-0dd9-4d3b-9c13-14a8924cea02","Type":"ContainerDied","Data":"951f6e2084092d06120e489f3309a85bcb83c5897db299c2af01f871b8f62ba3"}
Aug 04 01:00:03.060323 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:03.060295    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a5b2e0-29763420-kcxnh"
Aug 04 01:00:03.922070 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:03.922044    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a5b2e0-29763420-kcxnh"
Aug 04 01:00:03.922283 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:03.922037    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a5b2e0-29763420-kcxnh" event={"ID":"39557c08-0dd9-4d3b-9c13-14a8924cea02","Type":"ContainerDied","Data":"d6ed5bb5297387203828d6d0bbfb8230829f703fb74729254b84fa20a61a0038"}
Aug 04 01:00:03.922283 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:03.922166    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6ed5bb5297387203828d6d0bbfb8230829f703fb74729254b84fa20a61a0038"
Aug 04 01:00:04.293818 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:04.293783    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763375-4rf8s"]
Aug 04 01:00:04.300226 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:04.300191    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29763375-4rf8s"]
Aug 04 01:00:04.307918 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:04.307886    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38434e90-302a-4f81-9759-60428302cae6" path="/var/lib/kubelet/pods/38434e90-302a-4f81-9759-60428302cae6/volumes"
Aug 04 01:00:26.811452 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:26.811410    2556 scope.go:117] "RemoveContainer" containerID="781595e6762509a74aa2de0ccd6d3ee64fb783441f20bc9d687b71b8e23f1490"
Aug 04 01:00:27.169276 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:27.169170    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"]
Aug 04 01:00:27.169453 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:27.169423    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb" podUID="65a50f1b-c1e7-4942-a597-ee271fa76f16" containerName="istio-proxy" containerID="cri-o://3afe943f6253befea5e2bf84edee16c477536d0c5e9f596964db0d29b9066902" gracePeriod=30
Aug 04 01:00:27.989522 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:27.989476    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 01:00:27.989936 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:27.989585    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb" podUID="65a50f1b-c1e7-4942-a597-ee271fa76f16" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 01:00:32.431964 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.431888    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 01:00:32.556278 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.556236    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-credential-socket\") pod \"65a50f1b-c1e7-4942-a597-ee271fa76f16\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") "
Aug 04 01:00:32.556278 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.556279    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-istio-data\") pod \"65a50f1b-c1e7-4942-a597-ee271fa76f16\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") "
Aug 04 01:00:32.556559 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.556294    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-workload-socket\") pod \"65a50f1b-c1e7-4942-a597-ee271fa76f16\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") "
Aug 04 01:00:32.556559 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.556357    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65a50f1b-c1e7-4942-a597-ee271fa76f16-istio-podinfo\") pod \"65a50f1b-c1e7-4942-a597-ee271fa76f16\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") "
Aug 04 01:00:32.556559 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.556375    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65a50f1b-c1e7-4942-a597-ee271fa76f16-istiod-ca-cert\") pod \"65a50f1b-c1e7-4942-a597-ee271fa76f16\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") "
Aug 04 01:00:32.556559 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.556402    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-workload-certs\") pod \"65a50f1b-c1e7-4942-a597-ee271fa76f16\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") "
Aug 04 01:00:32.556559 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.556439    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9bw2\" (UniqueName: \"kubernetes.io/projected/65a50f1b-c1e7-4942-a597-ee271fa76f16-kube-api-access-q9bw2\") pod \"65a50f1b-c1e7-4942-a597-ee271fa76f16\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") "
Aug 04 01:00:32.556834 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.556517    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65a50f1b-c1e7-4942-a597-ee271fa76f16-istio-token\") pod \"65a50f1b-c1e7-4942-a597-ee271fa76f16\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") "
Aug 04 01:00:32.556901 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.556604    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "65a50f1b-c1e7-4942-a597-ee271fa76f16" (UID: "65a50f1b-c1e7-4942-a597-ee271fa76f16"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 01:00:32.556963 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.556620    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-istio-data" (OuterVolumeSpecName: "istio-data") pod "65a50f1b-c1e7-4942-a597-ee271fa76f16" (UID: "65a50f1b-c1e7-4942-a597-ee271fa76f16"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 01:00:32.556963 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.556707    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "65a50f1b-c1e7-4942-a597-ee271fa76f16" (UID: "65a50f1b-c1e7-4942-a597-ee271fa76f16"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 01:00:32.556963 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.556887    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-istio-envoy\") pod \"65a50f1b-c1e7-4942-a597-ee271fa76f16\" (UID: \"65a50f1b-c1e7-4942-a597-ee271fa76f16\") "
Aug 04 01:00:32.557101 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.556781    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "65a50f1b-c1e7-4942-a597-ee271fa76f16" (UID: "65a50f1b-c1e7-4942-a597-ee271fa76f16"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 01:00:32.557101 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.556846    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65a50f1b-c1e7-4942-a597-ee271fa76f16-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "65a50f1b-c1e7-4942-a597-ee271fa76f16" (UID: "65a50f1b-c1e7-4942-a597-ee271fa76f16"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 01:00:32.557402 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.557375    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65a50f1b-c1e7-4942-a597-ee271fa76f16-istiod-ca-cert\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:00:32.557402 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.557400    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-workload-certs\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:00:32.557402 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.557409    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-credential-socket\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:00:32.557677 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.557418    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-istio-data\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:00:32.557677 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.557427    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-workload-socket\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:00:32.559014 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.558980    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65a50f1b-c1e7-4942-a597-ee271fa76f16-kube-api-access-q9bw2" (OuterVolumeSpecName: "kube-api-access-q9bw2") pod "65a50f1b-c1e7-4942-a597-ee271fa76f16" (UID: "65a50f1b-c1e7-4942-a597-ee271fa76f16"). InnerVolumeSpecName "kube-api-access-q9bw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 01:00:32.559151 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.559008    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "65a50f1b-c1e7-4942-a597-ee271fa76f16" (UID: "65a50f1b-c1e7-4942-a597-ee271fa76f16"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 01:00:32.559218 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.559191    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/65a50f1b-c1e7-4942-a597-ee271fa76f16-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "65a50f1b-c1e7-4942-a597-ee271fa76f16" (UID: "65a50f1b-c1e7-4942-a597-ee271fa76f16"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 01:00:32.559283 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.559248    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65a50f1b-c1e7-4942-a597-ee271fa76f16-istio-token" (OuterVolumeSpecName: "istio-token") pod "65a50f1b-c1e7-4942-a597-ee271fa76f16" (UID: "65a50f1b-c1e7-4942-a597-ee271fa76f16"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 01:00:32.658294 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.658245    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65a50f1b-c1e7-4942-a597-ee271fa76f16-istio-podinfo\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:00:32.658294 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.658284    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9bw2\" (UniqueName: \"kubernetes.io/projected/65a50f1b-c1e7-4942-a597-ee271fa76f16-kube-api-access-q9bw2\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:00:32.658294 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.658297    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65a50f1b-c1e7-4942-a597-ee271fa76f16-istio-token\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:00:32.658294 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:32.658306    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65a50f1b-c1e7-4942-a597-ee271fa76f16-istio-envoy\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:00:33.081475 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:33.081436    2556 generic.go:356] "Generic (PLEG): container finished" podID="65a50f1b-c1e7-4942-a597-ee271fa76f16" containerID="3afe943f6253befea5e2bf84edee16c477536d0c5e9f596964db0d29b9066902" exitCode=0
Aug 04 01:00:33.081706 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:33.081499    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"
Aug 04 01:00:33.081706 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:33.081517    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb" event={"ID":"65a50f1b-c1e7-4942-a597-ee271fa76f16","Type":"ContainerDied","Data":"3afe943f6253befea5e2bf84edee16c477536d0c5e9f596964db0d29b9066902"}
Aug 04 01:00:33.081706 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:33.081611    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb" event={"ID":"65a50f1b-c1e7-4942-a597-ee271fa76f16","Type":"ContainerDied","Data":"733e426fb545d9d272b410c70d2e487168e9a6e897e50f44216112a35cd9a57d"}
Aug 04 01:00:33.081706 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:33.081646    2556 scope.go:117] "RemoveContainer" containerID="3afe943f6253befea5e2bf84edee16c477536d0c5e9f596964db0d29b9066902"
Aug 04 01:00:33.092251 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:33.092227    2556 scope.go:117] "RemoveContainer" containerID="45b1edb55c667e6482aa21afac31b57c6fc848318e092004bc5556707c586236"
Aug 04 01:00:33.101518 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:33.101474    2556 scope.go:117] "RemoveContainer" containerID="3afe943f6253befea5e2bf84edee16c477536d0c5e9f596964db0d29b9066902"
Aug 04 01:00:33.102028 ip-10-0-143-2 kubenswrapper[2556]: E0804 01:00:33.102000    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3afe943f6253befea5e2bf84edee16c477536d0c5e9f596964db0d29b9066902\": container with ID starting with 3afe943f6253befea5e2bf84edee16c477536d0c5e9f596964db0d29b9066902 not found: ID does not exist" containerID="3afe943f6253befea5e2bf84edee16c477536d0c5e9f596964db0d29b9066902"
Aug 04 01:00:33.102147 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:33.102038    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3afe943f6253befea5e2bf84edee16c477536d0c5e9f596964db0d29b9066902"} err="failed to get container status \"3afe943f6253befea5e2bf84edee16c477536d0c5e9f596964db0d29b9066902\": rpc error: code = NotFound desc = could not find container \"3afe943f6253befea5e2bf84edee16c477536d0c5e9f596964db0d29b9066902\": container with ID starting with 3afe943f6253befea5e2bf84edee16c477536d0c5e9f596964db0d29b9066902 not found: ID does not exist"
Aug 04 01:00:33.102147 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:33.102064    2556 scope.go:117] "RemoveContainer" containerID="45b1edb55c667e6482aa21afac31b57c6fc848318e092004bc5556707c586236"
Aug 04 01:00:33.102386 ip-10-0-143-2 kubenswrapper[2556]: E0804 01:00:33.102363    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45b1edb55c667e6482aa21afac31b57c6fc848318e092004bc5556707c586236\": container with ID starting with 45b1edb55c667e6482aa21afac31b57c6fc848318e092004bc5556707c586236 not found: ID does not exist" containerID="45b1edb55c667e6482aa21afac31b57c6fc848318e092004bc5556707c586236"
Aug 04 01:00:33.102475 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:33.102394    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45b1edb55c667e6482aa21afac31b57c6fc848318e092004bc5556707c586236"} err="failed to get container status \"45b1edb55c667e6482aa21afac31b57c6fc848318e092004bc5556707c586236\": rpc error: code = NotFound desc = could not find container \"45b1edb55c667e6482aa21afac31b57c6fc848318e092004bc5556707c586236\": container with ID starting with 45b1edb55c667e6482aa21afac31b57c6fc848318e092004bc5556707c586236 not found: ID does not exist"
Aug 04 01:00:33.104593 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:33.104568    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"]
Aug 04 01:00:33.108043 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:33.108019    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-579628-openshift-default-5c84c9d7bd-m89zb"]
Aug 04 01:00:34.308095 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:34.308062    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65a50f1b-c1e7-4942-a597-ee271fa76f16" path="/var/lib/kubelet/pods/65a50f1b-c1e7-4942-a597-ee271fa76f16/volumes"
Aug 04 01:00:45.013878 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:45.013839    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"]
Aug 04 01:00:45.014409 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:45.014068    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7" podUID="823eee5a-32b0-4676-a85d-eeaf20cfdda9" containerName="istio-proxy" containerID="cri-o://fb2dada62f5ba03ff4f82a27a549122e134581a8f16875fe73aa3cade355e8ff" gracePeriod=30
Aug 04 01:00:50.174055 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.174020    2556 generic.go:356] "Generic (PLEG): container finished" podID="823eee5a-32b0-4676-a85d-eeaf20cfdda9" containerID="fb2dada62f5ba03ff4f82a27a549122e134581a8f16875fe73aa3cade355e8ff" exitCode=0
Aug 04 01:00:50.174521 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.174064    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7" event={"ID":"823eee5a-32b0-4676-a85d-eeaf20cfdda9","Type":"ContainerDied","Data":"fb2dada62f5ba03ff4f82a27a549122e134581a8f16875fe73aa3cade355e8ff"}
Aug 04 01:00:50.174521 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.174144    2556 scope.go:117] "RemoveContainer" containerID="16fcf8977faa08e247dee6b8a7fec43cf6ca4140bcbf0bdf7aa269223b9feb0f"
Aug 04 01:00:50.278084 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.278009    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 01:00:50.321232 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.321196    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istio-podinfo\") pod \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") "
Aug 04 01:00:50.321428 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.321249    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istiod-ca-cert\") pod \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") "
Aug 04 01:00:50.321428 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.321293    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istio-envoy\") pod \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") "
Aug 04 01:00:50.321428 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.321334    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-workload-certs\") pod \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") "
Aug 04 01:00:50.321428 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.321359    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-workload-socket\") pod \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") "
Aug 04 01:00:50.321428 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.321405    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-credential-socket\") pod \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") "
Aug 04 01:00:50.321703 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.321451    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istio-data\") pod \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") "
Aug 04 01:00:50.321703 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.321501    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nh4k\" (UniqueName: \"kubernetes.io/projected/823eee5a-32b0-4676-a85d-eeaf20cfdda9-kube-api-access-2nh4k\") pod \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") "
Aug 04 01:00:50.321703 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.321548    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istio-token\") pod \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\" (UID: \"823eee5a-32b0-4676-a85d-eeaf20cfdda9\") "
Aug 04 01:00:50.321703 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.321691    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "823eee5a-32b0-4676-a85d-eeaf20cfdda9" (UID: "823eee5a-32b0-4676-a85d-eeaf20cfdda9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 01:00:50.321963 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.321746    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "823eee5a-32b0-4676-a85d-eeaf20cfdda9" (UID: "823eee5a-32b0-4676-a85d-eeaf20cfdda9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 01:00:50.321963 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.321842    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istio-data" (OuterVolumeSpecName: "istio-data") pod "823eee5a-32b0-4676-a85d-eeaf20cfdda9" (UID: "823eee5a-32b0-4676-a85d-eeaf20cfdda9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 01:00:50.321963 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.321941    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "823eee5a-32b0-4676-a85d-eeaf20cfdda9" (UID: "823eee5a-32b0-4676-a85d-eeaf20cfdda9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 01:00:50.322131 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.321960    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "823eee5a-32b0-4676-a85d-eeaf20cfdda9" (UID: "823eee5a-32b0-4676-a85d-eeaf20cfdda9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 01:00:50.322131 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.322047    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istiod-ca-cert\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:00:50.322131 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.322066    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-workload-certs\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:00:50.322131 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.322086    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-workload-socket\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:00:50.322131 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.322103    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-credential-socket\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:00:50.322131 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.322116    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istio-data\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:00:50.324034 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.324004    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istio-token" (OuterVolumeSpecName: "istio-token") pod "823eee5a-32b0-4676-a85d-eeaf20cfdda9" (UID: "823eee5a-32b0-4676-a85d-eeaf20cfdda9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 01:00:50.324189 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.324163    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "823eee5a-32b0-4676-a85d-eeaf20cfdda9" (UID: "823eee5a-32b0-4676-a85d-eeaf20cfdda9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 01:00:50.324254 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.324160    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/823eee5a-32b0-4676-a85d-eeaf20cfdda9-kube-api-access-2nh4k" (OuterVolumeSpecName: "kube-api-access-2nh4k") pod "823eee5a-32b0-4676-a85d-eeaf20cfdda9" (UID: "823eee5a-32b0-4676-a85d-eeaf20cfdda9"). InnerVolumeSpecName "kube-api-access-2nh4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 01:00:50.324254 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.324198    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "823eee5a-32b0-4676-a85d-eeaf20cfdda9" (UID: "823eee5a-32b0-4676-a85d-eeaf20cfdda9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 01:00:50.423580 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.423540    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nh4k\" (UniqueName: \"kubernetes.io/projected/823eee5a-32b0-4676-a85d-eeaf20cfdda9-kube-api-access-2nh4k\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:00:50.423580 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.423573    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istio-token\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:00:50.423580 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.423582    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istio-podinfo\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:00:50.423580 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:50.423592    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/823eee5a-32b0-4676-a85d-eeaf20cfdda9-istio-envoy\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:00:51.180657 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:51.180624    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"
Aug 04 01:00:51.180657 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:51.180647    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7" event={"ID":"823eee5a-32b0-4676-a85d-eeaf20cfdda9","Type":"ContainerDied","Data":"1981c15630a3e55cd41f2dde418d9043bf352d1ea04de9c6fa55883adc430e0e"}
Aug 04 01:00:51.181231 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:51.180745    2556 scope.go:117] "RemoveContainer" containerID="fb2dada62f5ba03ff4f82a27a549122e134581a8f16875fe73aa3cade355e8ff"
Aug 04 01:00:51.203341 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:51.203302    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"]
Aug 04 01:00:51.206295 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:51.206263    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-f277ac-openshift-default-5dfbc4847b-qfnn7"]
Aug 04 01:00:52.307933 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:52.307902    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="823eee5a-32b0-4676-a85d-eeaf20cfdda9" path="/var/lib/kubelet/pods/823eee5a-32b0-4676-a85d-eeaf20cfdda9/volumes"
Aug 04 01:00:55.828736 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:55.825665    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a5b2e0-29763420-kcxnh"]
Aug 04 01:00:55.833977 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:55.833945    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a5b2e0-29763420-kcxnh"]
Aug 04 01:00:56.307629 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:00:56.307591    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39557c08-0dd9-4d3b-9c13-14a8924cea02" path="/var/lib/kubelet/pods/39557c08-0dd9-4d3b-9c13-14a8924cea02/volumes"
Aug 04 01:01:03.141729 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:03.141671    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5396f3-tkvk7"]
Aug 04 01:01:03.142104 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:03.142095    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="823eee5a-32b0-4676-a85d-eeaf20cfdda9" containerName="istio-proxy"
Aug 04 01:01:03.142161 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:03.142108    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="823eee5a-32b0-4676-a85d-eeaf20cfdda9" containerName="istio-proxy"
Aug 04 01:01:03.142161 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:03.142130    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65a50f1b-c1e7-4942-a597-ee271fa76f16" containerName="istio-proxy"
Aug 04 01:01:03.142161 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:03.142136    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="65a50f1b-c1e7-4942-a597-ee271fa76f16" containerName="istio-proxy"
Aug 04 01:01:03.142161 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:03.142144    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="823eee5a-32b0-4676-a85d-eeaf20cfdda9" containerName="istio-proxy"
Aug 04 01:01:03.142161 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:03.142149    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="823eee5a-32b0-4676-a85d-eeaf20cfdda9" containerName="istio-proxy"
Aug 04 01:01:03.142323 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:03.142168    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39557c08-0dd9-4d3b-9c13-14a8924cea02" containerName="cleanup"
Aug 04 01:01:03.142323 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:03.142174    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="39557c08-0dd9-4d3b-9c13-14a8924cea02" containerName="cleanup"
Aug 04 01:01:03.142323 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:03.142238    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="39557c08-0dd9-4d3b-9c13-14a8924cea02" containerName="cleanup"
Aug 04 01:01:03.142323 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:03.142249    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="823eee5a-32b0-4676-a85d-eeaf20cfdda9" containerName="istio-proxy"
Aug 04 01:01:03.142323 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:03.142256    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="65a50f1b-c1e7-4942-a597-ee271fa76f16" containerName="istio-proxy"
Aug 04 01:01:03.142323 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:03.142262    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="823eee5a-32b0-4676-a85d-eeaf20cfdda9" containerName="istio-proxy"
Aug 04 01:01:03.142323 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:03.142269    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="65a50f1b-c1e7-4942-a597-ee271fa76f16" containerName="istio-proxy"
Aug 04 01:01:03.147079 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:03.147060    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5396f3-tkvk7"
Aug 04 01:01:03.150062 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:03.150038    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8db7m\""
Aug 04 01:01:03.163573 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:03.163530    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5396f3-tkvk7"]
Aug 04 01:01:03.247627 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:03.247592    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bcbb9dc-2cee-4748-a536-a1d368661f52-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-5396f3-tkvk7\" (UID: \"2bcbb9dc-2cee-4748-a536-a1d368661f52\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5396f3-tkvk7"
Aug 04 01:01:03.348558 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:03.348524    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bcbb9dc-2cee-4748-a536-a1d368661f52-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-5396f3-tkvk7\" (UID: \"2bcbb9dc-2cee-4748-a536-a1d368661f52\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5396f3-tkvk7"
Aug 04 01:01:03.349175 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:03.349146    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bcbb9dc-2cee-4748-a536-a1d368661f52-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-5396f3-tkvk7\" (UID: \"2bcbb9dc-2cee-4748-a536-a1d368661f52\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5396f3-tkvk7"
Aug 04 01:01:03.457326 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:03.457241    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5396f3-tkvk7"
Aug 04 01:01:03.596859 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:03.596821    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5396f3-tkvk7"]
Aug 04 01:01:03.600622 ip-10-0-143-2 kubenswrapper[2556]: W0804 01:01:03.600596    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bcbb9dc_2cee_4748_a536_a1d368661f52.slice/crio-f9b446d132a30504a45c55d7d7275f47f367101b4468007e752810b73a2cda12 WatchSource:0}: Error finding container f9b446d132a30504a45c55d7d7275f47f367101b4468007e752810b73a2cda12: Status 404 returned error can't find the container with id f9b446d132a30504a45c55d7d7275f47f367101b4468007e752810b73a2cda12
Aug 04 01:01:04.251121 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:04.251084    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5396f3-tkvk7" event={"ID":"2bcbb9dc-2cee-4748-a536-a1d368661f52","Type":"ContainerStarted","Data":"5d5e83ce5eb5a08576079ed53efc99cd4f994f259dffe4c2fcf26bb1656e77b1"}
Aug 04 01:01:04.251505 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:04.251142    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5396f3-tkvk7" event={"ID":"2bcbb9dc-2cee-4748-a536-a1d368661f52","Type":"ContainerStarted","Data":"f9b446d132a30504a45c55d7d7275f47f367101b4468007e752810b73a2cda12"}
Aug 04 01:01:04.269890 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:04.269834    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5396f3-tkvk7" podStartSLOduration=1.269817669 podStartE2EDuration="1.269817669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 01:01:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 01:01:04.267038742 +0000 UTC m=+3518.435676126" watchObservedRunningTime="2026-08-04 01:01:04.269817669 +0000 UTC m=+3518.438455040"
Aug 04 01:01:05.259036 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:05.258999    2556 generic.go:356] "Generic (PLEG): container finished" podID="2bcbb9dc-2cee-4748-a536-a1d368661f52" containerID="5d5e83ce5eb5a08576079ed53efc99cd4f994f259dffe4c2fcf26bb1656e77b1" exitCode=0
Aug 04 01:01:05.259501 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:05.259100    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5396f3-tkvk7" event={"ID":"2bcbb9dc-2cee-4748-a536-a1d368661f52","Type":"ContainerDied","Data":"5d5e83ce5eb5a08576079ed53efc99cd4f994f259dffe4c2fcf26bb1656e77b1"}
Aug 04 01:01:06.411802 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:06.411771    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5396f3-tkvk7"
Aug 04 01:01:06.480029 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:06.479988    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bcbb9dc-2cee-4748-a536-a1d368661f52-maas-api-service-ca\") pod \"2bcbb9dc-2cee-4748-a536-a1d368661f52\" (UID: \"2bcbb9dc-2cee-4748-a536-a1d368661f52\") "
Aug 04 01:01:06.480370 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:06.480343    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bcbb9dc-2cee-4748-a536-a1d368661f52-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2bcbb9dc-2cee-4748-a536-a1d368661f52" (UID: "2bcbb9dc-2cee-4748-a536-a1d368661f52"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 01:01:06.581315 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:06.581220    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bcbb9dc-2cee-4748-a536-a1d368661f52-maas-api-service-ca\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:01:07.274434 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:07.274403    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5396f3-tkvk7"
Aug 04 01:01:07.274434 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:07.274431    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5396f3-tkvk7" event={"ID":"2bcbb9dc-2cee-4748-a536-a1d368661f52","Type":"ContainerDied","Data":"f9b446d132a30504a45c55d7d7275f47f367101b4468007e752810b73a2cda12"}
Aug 04 01:01:07.274705 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:07.274492    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f9b446d132a30504a45c55d7d7275f47f367101b4468007e752810b73a2cda12"
Aug 04 01:01:13.780356 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:13.780310    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5396f3-tkvk7"]
Aug 04 01:01:13.783165 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:13.783138    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5396f3-tkvk7"]
Aug 04 01:01:14.307651 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:14.307615    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bcbb9dc-2cee-4748-a536-a1d368661f52" path="/var/lib/kubelet/pods/2bcbb9dc-2cee-4748-a536-a1d368661f52/volumes"
Aug 04 01:01:20.472948 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:20.472909    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"]
Aug 04 01:01:20.473478 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:20.473164    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv" podUID="987130cc-be19-4a0b-9f07-6c062c4a1d84" containerName="istio-proxy" containerID="cri-o://a9a0d4f42450d42246603de9c33c941a5f1f189018da24060e5ffc4cf5f61a35" gracePeriod=30
Aug 04 01:01:21.137042 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:21.137006    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8454d85f66-mhktw_7ef51f93-dbe2-443b-bc49-9d49d6b2f41e/authorino/0.log"
Aug 04 01:01:25.725197 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.725172    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 01:01:25.760449 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.760419    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/987130cc-be19-4a0b-9f07-6c062c4a1d84-istio-podinfo\") pod \"987130cc-be19-4a0b-9f07-6c062c4a1d84\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") "
Aug 04 01:01:25.760602 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.760460    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-istio-data\") pod \"987130cc-be19-4a0b-9f07-6c062c4a1d84\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") "
Aug 04 01:01:25.760602 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.760485    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/987130cc-be19-4a0b-9f07-6c062c4a1d84-istio-token\") pod \"987130cc-be19-4a0b-9f07-6c062c4a1d84\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") "
Aug 04 01:01:25.760602 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.760507    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-workload-socket\") pod \"987130cc-be19-4a0b-9f07-6c062c4a1d84\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") "
Aug 04 01:01:25.760602 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.760547    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-istio-envoy\") pod \"987130cc-be19-4a0b-9f07-6c062c4a1d84\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") "
Aug 04 01:01:25.760602 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.760567    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/987130cc-be19-4a0b-9f07-6c062c4a1d84-istiod-ca-cert\") pod \"987130cc-be19-4a0b-9f07-6c062c4a1d84\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") "
Aug 04 01:01:25.760925 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.760629    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-workload-certs\") pod \"987130cc-be19-4a0b-9f07-6c062c4a1d84\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") "
Aug 04 01:01:25.760925 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.760673    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-credential-socket\") pod \"987130cc-be19-4a0b-9f07-6c062c4a1d84\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") "
Aug 04 01:01:25.760925 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.760703    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psvbb\" (UniqueName: \"kubernetes.io/projected/987130cc-be19-4a0b-9f07-6c062c4a1d84-kube-api-access-psvbb\") pod \"987130cc-be19-4a0b-9f07-6c062c4a1d84\" (UID: \"987130cc-be19-4a0b-9f07-6c062c4a1d84\") "
Aug 04 01:01:25.760925 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.760767    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-istio-data" (OuterVolumeSpecName: "istio-data") pod "987130cc-be19-4a0b-9f07-6c062c4a1d84" (UID: "987130cc-be19-4a0b-9f07-6c062c4a1d84"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 01:01:25.760925 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.760798    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "987130cc-be19-4a0b-9f07-6c062c4a1d84" (UID: "987130cc-be19-4a0b-9f07-6c062c4a1d84"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 01:01:25.761205 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.761064    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-istio-data\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:01:25.761205 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.761085    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-workload-socket\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:01:25.761205 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.761175    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/987130cc-be19-4a0b-9f07-6c062c4a1d84-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "987130cc-be19-4a0b-9f07-6c062c4a1d84" (UID: "987130cc-be19-4a0b-9f07-6c062c4a1d84"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 01:01:25.761428 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.761402    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "987130cc-be19-4a0b-9f07-6c062c4a1d84" (UID: "987130cc-be19-4a0b-9f07-6c062c4a1d84"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 01:01:25.761519 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.761494    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "987130cc-be19-4a0b-9f07-6c062c4a1d84" (UID: "987130cc-be19-4a0b-9f07-6c062c4a1d84"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 01:01:25.762983 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.762954    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/987130cc-be19-4a0b-9f07-6c062c4a1d84-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "987130cc-be19-4a0b-9f07-6c062c4a1d84" (UID: "987130cc-be19-4a0b-9f07-6c062c4a1d84"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 01:01:25.763203 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.763168    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/987130cc-be19-4a0b-9f07-6c062c4a1d84-istio-token" (OuterVolumeSpecName: "istio-token") pod "987130cc-be19-4a0b-9f07-6c062c4a1d84" (UID: "987130cc-be19-4a0b-9f07-6c062c4a1d84"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 01:01:25.763310 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.763234    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "987130cc-be19-4a0b-9f07-6c062c4a1d84" (UID: "987130cc-be19-4a0b-9f07-6c062c4a1d84"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 01:01:25.763448 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.763430    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/987130cc-be19-4a0b-9f07-6c062c4a1d84-kube-api-access-psvbb" (OuterVolumeSpecName: "kube-api-access-psvbb") pod "987130cc-be19-4a0b-9f07-6c062c4a1d84" (UID: "987130cc-be19-4a0b-9f07-6c062c4a1d84"). InnerVolumeSpecName "kube-api-access-psvbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 01:01:25.861865 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.861833    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-istio-envoy\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:01:25.861865 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.861856    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/987130cc-be19-4a0b-9f07-6c062c4a1d84-istiod-ca-cert\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:01:25.861865 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.861864    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-workload-certs\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:01:25.862084 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.861874    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/987130cc-be19-4a0b-9f07-6c062c4a1d84-credential-socket\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:01:25.862084 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.861883    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psvbb\" (UniqueName: \"kubernetes.io/projected/987130cc-be19-4a0b-9f07-6c062c4a1d84-kube-api-access-psvbb\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:01:25.862084 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.861892    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/987130cc-be19-4a0b-9f07-6c062c4a1d84-istio-podinfo\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:01:25.862084 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:25.861899    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/987130cc-be19-4a0b-9f07-6c062c4a1d84-istio-token\") on node \"ip-10-0-143-2.ec2.internal\" DevicePath \"\""
Aug 04 01:01:26.233117 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:26.233019    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-wv55h_d9eb0425-3fc2-42b2-89f4-edc38c47f37c/manager/0.log"
Aug 04 01:01:26.349493 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:26.349469    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-87768_0879b03f-6e77-4f5f-8a8a-8a07eb1c922d/manager/0.log"
Aug 04 01:01:26.382884 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:26.382851    2556 generic.go:356] "Generic (PLEG): container finished" podID="987130cc-be19-4a0b-9f07-6c062c4a1d84" containerID="a9a0d4f42450d42246603de9c33c941a5f1f189018da24060e5ffc4cf5f61a35" exitCode=0
Aug 04 01:01:26.383013 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:26.382907    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"
Aug 04 01:01:26.383013 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:26.382925    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv" event={"ID":"987130cc-be19-4a0b-9f07-6c062c4a1d84","Type":"ContainerDied","Data":"a9a0d4f42450d42246603de9c33c941a5f1f189018da24060e5ffc4cf5f61a35"}
Aug 04 01:01:26.383013 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:26.382977    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv" event={"ID":"987130cc-be19-4a0b-9f07-6c062c4a1d84","Type":"ContainerDied","Data":"82a2bb81725b70fb19080e9139f0be34e51d903b7f1069c0357ce0ea1cb0583a"}
Aug 04 01:01:26.383013 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:26.383006    2556 scope.go:117] "RemoveContainer" containerID="a9a0d4f42450d42246603de9c33c941a5f1f189018da24060e5ffc4cf5f61a35"
Aug 04 01:01:26.391950 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:26.391923    2556 scope.go:117] "RemoveContainer" containerID="d05587a41f5db00d91876c2abead75b11e6b0e06ff810aaf132b374d6ad50d42"
Aug 04 01:01:26.399596 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:26.399579    2556 scope.go:117] "RemoveContainer" containerID="a9a0d4f42450d42246603de9c33c941a5f1f189018da24060e5ffc4cf5f61a35"
Aug 04 01:01:26.400032 ip-10-0-143-2 kubenswrapper[2556]: E0804 01:01:26.399899    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9a0d4f42450d42246603de9c33c941a5f1f189018da24060e5ffc4cf5f61a35\": container with ID starting with a9a0d4f42450d42246603de9c33c941a5f1f189018da24060e5ffc4cf5f61a35 not found: ID does not exist" containerID="a9a0d4f42450d42246603de9c33c941a5f1f189018da24060e5ffc4cf5f61a35"
Aug 04 01:01:26.400032 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:26.399950    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9a0d4f42450d42246603de9c33c941a5f1f189018da24060e5ffc4cf5f61a35"} err="failed to get container status \"a9a0d4f42450d42246603de9c33c941a5f1f189018da24060e5ffc4cf5f61a35\": rpc error: code = NotFound desc = could not find container \"a9a0d4f42450d42246603de9c33c941a5f1f189018da24060e5ffc4cf5f61a35\": container with ID starting with a9a0d4f42450d42246603de9c33c941a5f1f189018da24060e5ffc4cf5f61a35 not found: ID does not exist"
Aug 04 01:01:26.400032 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:26.399972    2556 scope.go:117] "RemoveContainer" containerID="d05587a41f5db00d91876c2abead75b11e6b0e06ff810aaf132b374d6ad50d42"
Aug 04 01:01:26.400698 ip-10-0-143-2 kubenswrapper[2556]: E0804 01:01:26.400445    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d05587a41f5db00d91876c2abead75b11e6b0e06ff810aaf132b374d6ad50d42\": container with ID starting with d05587a41f5db00d91876c2abead75b11e6b0e06ff810aaf132b374d6ad50d42 not found: ID does not exist" containerID="d05587a41f5db00d91876c2abead75b11e6b0e06ff810aaf132b374d6ad50d42"
Aug 04 01:01:26.400698 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:26.400474    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d05587a41f5db00d91876c2abead75b11e6b0e06ff810aaf132b374d6ad50d42"} err="failed to get container status \"d05587a41f5db00d91876c2abead75b11e6b0e06ff810aaf132b374d6ad50d42\": rpc error: code = NotFound desc = could not find container \"d05587a41f5db00d91876c2abead75b11e6b0e06ff810aaf132b374d6ad50d42\": container with ID starting with d05587a41f5db00d91876c2abead75b11e6b0e06ff810aaf132b374d6ad50d42 not found: ID does not exist"
Aug 04 01:01:26.402552 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:26.402535    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"]
Aug 04 01:01:26.409847 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:26.409046    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-5396f3-openshift-default-6bd98769f6-766qv"]
Aug 04 01:01:26.813069 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:26.813039    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8594b76987-dvncd_df99b7ed-d36e-490e-87d4-53cb35e0ef95/copy-manifests/0.log"
Aug 04 01:01:26.819625 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:26.819601    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8594b76987-dvncd_df99b7ed-d36e-490e-87d4-53cb35e0ef95/manager/0.log"
Aug 04 01:01:27.513790 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:27.513753    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29763390-pxms5_698b277b-c990-470d-b397-d3a076292f91/cleanup/0.log"
Aug 04 01:01:27.616647 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:27.616620    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29763405-lzkdh_2fb88adf-e843-49be-a344-b79b76b8a7f6/cleanup/0.log"
Aug 04 01:01:27.833121 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:27.833045    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-fxk6z_a6a564c2-249b-48c1-bdab-cefc1ca2b2cf/postgres/0.log"
Aug 04 01:01:28.307615 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:28.307578    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="987130cc-be19-4a0b-9f07-6c062c4a1d84" path="/var/lib/kubelet/pods/987130cc-be19-4a0b-9f07-6c062c4a1d84/volumes"
Aug 04 01:01:28.581945 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:28.581862    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8454d85f66-mhktw_7ef51f93-dbe2-443b-bc49-9d49d6b2f41e/authorino/0.log"
Aug 04 01:01:29.579181 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:29.579149    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf_044a1248-d03f-4909-96b4-637aee3a2ebf/istio-proxy/0.log"
Aug 04 01:01:29.803232 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:29.803202    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57f7cf7b5f-9tfr9_cc1812f9-3025-4c7d-8841-479b66bd453a/kube-auth-proxy/0.log"
Aug 04 01:01:30.991940 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:30.991911    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fktqbb_66ebea31-67e0-46a3-a829-0aefdd1834be/main/0.log"
Aug 04 01:01:36.068796 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.068764    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6jcsw/must-gather-nmlq9"]
Aug 04 01:01:36.069178 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.069165    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="987130cc-be19-4a0b-9f07-6c062c4a1d84" containerName="istio-proxy"
Aug 04 01:01:36.069238 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.069179    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="987130cc-be19-4a0b-9f07-6c062c4a1d84" containerName="istio-proxy"
Aug 04 01:01:36.069238 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.069192    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="987130cc-be19-4a0b-9f07-6c062c4a1d84" containerName="istio-proxy"
Aug 04 01:01:36.069238 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.069198    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="987130cc-be19-4a0b-9f07-6c062c4a1d84" containerName="istio-proxy"
Aug 04 01:01:36.069238 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.069207    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bcbb9dc-2cee-4748-a536-a1d368661f52" containerName="revoke-keys"
Aug 04 01:01:36.069238 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.069213    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bcbb9dc-2cee-4748-a536-a1d368661f52" containerName="revoke-keys"
Aug 04 01:01:36.069238 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.069219    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65a50f1b-c1e7-4942-a597-ee271fa76f16" containerName="istio-proxy"
Aug 04 01:01:36.069238 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.069224    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="65a50f1b-c1e7-4942-a597-ee271fa76f16" containerName="istio-proxy"
Aug 04 01:01:36.069452 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.069283    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="987130cc-be19-4a0b-9f07-6c062c4a1d84" containerName="istio-proxy"
Aug 04 01:01:36.069452 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.069291    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bcbb9dc-2cee-4748-a536-a1d368661f52" containerName="revoke-keys"
Aug 04 01:01:36.069452 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.069297    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="987130cc-be19-4a0b-9f07-6c062c4a1d84" containerName="istio-proxy"
Aug 04 01:01:36.074366 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.074344    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6jcsw/must-gather-nmlq9"
Aug 04 01:01:36.076710 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.076688    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6jcsw\"/\"kube-root-ca.crt\""
Aug 04 01:01:36.076821 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.076770    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6jcsw\"/\"openshift-service-ca.crt\""
Aug 04 01:01:36.080744 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.080704    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6jcsw/must-gather-nmlq9"]
Aug 04 01:01:36.155762 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.155730    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/815d2744-4bbc-4105-91d0-8b655db8fa2d-must-gather-output\") pod \"must-gather-nmlq9\" (UID: \"815d2744-4bbc-4105-91d0-8b655db8fa2d\") " pod="openshift-must-gather-6jcsw/must-gather-nmlq9"
Aug 04 01:01:36.155886 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.155807    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9s89\" (UniqueName: \"kubernetes.io/projected/815d2744-4bbc-4105-91d0-8b655db8fa2d-kube-api-access-h9s89\") pod \"must-gather-nmlq9\" (UID: \"815d2744-4bbc-4105-91d0-8b655db8fa2d\") " pod="openshift-must-gather-6jcsw/must-gather-nmlq9"
Aug 04 01:01:36.256484 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.256456    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/815d2744-4bbc-4105-91d0-8b655db8fa2d-must-gather-output\") pod \"must-gather-nmlq9\" (UID: \"815d2744-4bbc-4105-91d0-8b655db8fa2d\") " pod="openshift-must-gather-6jcsw/must-gather-nmlq9"
Aug 04 01:01:36.256648 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.256534    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9s89\" (UniqueName: \"kubernetes.io/projected/815d2744-4bbc-4105-91d0-8b655db8fa2d-kube-api-access-h9s89\") pod \"must-gather-nmlq9\" (UID: \"815d2744-4bbc-4105-91d0-8b655db8fa2d\") " pod="openshift-must-gather-6jcsw/must-gather-nmlq9"
Aug 04 01:01:36.256839 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.256817    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/815d2744-4bbc-4105-91d0-8b655db8fa2d-must-gather-output\") pod \"must-gather-nmlq9\" (UID: \"815d2744-4bbc-4105-91d0-8b655db8fa2d\") " pod="openshift-must-gather-6jcsw/must-gather-nmlq9"
Aug 04 01:01:36.264394 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.264370    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9s89\" (UniqueName: \"kubernetes.io/projected/815d2744-4bbc-4105-91d0-8b655db8fa2d-kube-api-access-h9s89\") pod \"must-gather-nmlq9\" (UID: \"815d2744-4bbc-4105-91d0-8b655db8fa2d\") " pod="openshift-must-gather-6jcsw/must-gather-nmlq9"
Aug 04 01:01:36.383563 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.383484    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6jcsw/must-gather-nmlq9"
Aug 04 01:01:36.526117 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.526086    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6jcsw/must-gather-nmlq9"]
Aug 04 01:01:36.529824 ip-10-0-143-2 kubenswrapper[2556]: W0804 01:01:36.529801    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod815d2744_4bbc_4105_91d0_8b655db8fa2d.slice/crio-41826168ea810071a20b4e6a5eec03f44bf85f762064cdcae46543d4742abd97 WatchSource:0}: Error finding container 41826168ea810071a20b4e6a5eec03f44bf85f762064cdcae46543d4742abd97: Status 404 returned error can't find the container with id 41826168ea810071a20b4e6a5eec03f44bf85f762064cdcae46543d4742abd97
Aug 04 01:01:36.531628 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:36.531611    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 01:01:37.441181 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:37.441151    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6jcsw/must-gather-nmlq9" event={"ID":"815d2744-4bbc-4105-91d0-8b655db8fa2d","Type":"ContainerStarted","Data":"880d99ae0a39082b909cfd52816d7a072249c4e9780078757ecd9530ba6544ff"}
Aug 04 01:01:37.441542 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:37.441201    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6jcsw/must-gather-nmlq9" event={"ID":"815d2744-4bbc-4105-91d0-8b655db8fa2d","Type":"ContainerStarted","Data":"41826168ea810071a20b4e6a5eec03f44bf85f762064cdcae46543d4742abd97"}
Aug 04 01:01:38.451390 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:38.451355    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6jcsw/must-gather-nmlq9" event={"ID":"815d2744-4bbc-4105-91d0-8b655db8fa2d","Type":"ContainerStarted","Data":"594d4dff9827346e2e15c1b7f10cfba669562ca4be8ea61b7bd28c5609291e6a"}
Aug 04 01:01:38.470087 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:38.470035    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6jcsw/must-gather-nmlq9" podStartSLOduration=1.6798617999999998 podStartE2EDuration="2.470017861s" totalImagesPullingTime="790.156061ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 01:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 01:01:38.468414923 +0000 UTC m=+3552.637052296" watchObservedRunningTime="2026-08-04 01:01:38.470017861 +0000 UTC m=+3552.638655231"
Aug 04 01:01:38.997843 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:38.997810    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hw9ff_1c75c58e-ca1e-40b0-8993-9a91f8214235/global-pull-secret-syncer/0.log"
Aug 04 01:01:39.091751 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:39.091704    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4wgvp_6f920924-9925-422d-b1d1-7b423471ffa2/konnectivity-agent/0.log"
Aug 04 01:01:39.211831 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:39.211804    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-2.ec2.internal_60020f9b08eeb842b087b428d24d6e5c/haproxy/0.log"
Aug 04 01:01:44.279733 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:44.279125    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8454d85f66-mhktw_7ef51f93-dbe2-443b-bc49-9d49d6b2f41e/authorino/0.log"
Aug 04 01:01:46.228604 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:46.228569    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e174b9d6-5792-451a-8fc7-47d36c452421/alertmanager/0.log"
Aug 04 01:01:46.253700 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:46.253662    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e174b9d6-5792-451a-8fc7-47d36c452421/config-reloader/0.log"
Aug 04 01:01:46.280938 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:46.280886    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e174b9d6-5792-451a-8fc7-47d36c452421/kube-rbac-proxy-web/0.log"
Aug 04 01:01:46.311421 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:46.311393    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e174b9d6-5792-451a-8fc7-47d36c452421/kube-rbac-proxy/0.log"
Aug 04 01:01:46.344593 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:46.344522    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e174b9d6-5792-451a-8fc7-47d36c452421/kube-rbac-proxy-metric/0.log"
Aug 04 01:01:46.380761 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:46.380647    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e174b9d6-5792-451a-8fc7-47d36c452421/prom-label-proxy/0.log"
Aug 04 01:01:46.400247 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:46.400179    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e174b9d6-5792-451a-8fc7-47d36c452421/init-config-reloader/0.log"
Aug 04 01:01:46.492255 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:46.492225    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-nz9jp_4f803ae9-0f3e-47fb-85f4-59a3742c5097/kube-state-metrics/0.log"
Aug 04 01:01:46.513689 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:46.513659    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-nz9jp_4f803ae9-0f3e-47fb-85f4-59a3742c5097/kube-rbac-proxy-main/0.log"
Aug 04 01:01:46.537020 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:46.536994    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-nz9jp_4f803ae9-0f3e-47fb-85f4-59a3742c5097/kube-rbac-proxy-self/0.log"
Aug 04 01:01:46.714189 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:46.714096    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vk6lq_c553ca6a-a9b4-4e6d-85af-666c7f19c2d2/node-exporter/0.log"
Aug 04 01:01:46.739664 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:46.739637    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vk6lq_c553ca6a-a9b4-4e6d-85af-666c7f19c2d2/kube-rbac-proxy/0.log"
Aug 04 01:01:46.767653 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:46.767632    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vk6lq_c553ca6a-a9b4-4e6d-85af-666c7f19c2d2/init-textfile/0.log"
Aug 04 01:01:46.868688 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:46.868657    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-9tvk5_fba4244d-9288-475b-b6b4-4fadeab11e97/kube-rbac-proxy-main/0.log"
Aug 04 01:01:46.891970 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:46.891916    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-9tvk5_fba4244d-9288-475b-b6b4-4fadeab11e97/kube-rbac-proxy-self/0.log"
Aug 04 01:01:46.914533 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:46.914501    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-9tvk5_fba4244d-9288-475b-b6b4-4fadeab11e97/openshift-state-metrics/0.log"
Aug 04 01:01:46.955816 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:46.955785    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_291cf0f7-2eab-4679-97dd-4be14941d34b/prometheus/0.log"
Aug 04 01:01:46.983599 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:46.983505    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_291cf0f7-2eab-4679-97dd-4be14941d34b/config-reloader/0.log"
Aug 04 01:01:47.008103 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:47.008076    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_291cf0f7-2eab-4679-97dd-4be14941d34b/thanos-sidecar/0.log"
Aug 04 01:01:47.048311 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:47.048284    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_291cf0f7-2eab-4679-97dd-4be14941d34b/kube-rbac-proxy-web/0.log"
Aug 04 01:01:47.095961 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:47.095904    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_291cf0f7-2eab-4679-97dd-4be14941d34b/kube-rbac-proxy/0.log"
Aug 04 01:01:47.121508 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:47.121483    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_291cf0f7-2eab-4679-97dd-4be14941d34b/kube-rbac-proxy-thanos/0.log"
Aug 04 01:01:47.146694 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:47.146665    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_291cf0f7-2eab-4679-97dd-4be14941d34b/init-config-reloader/0.log"
Aug 04 01:01:47.186622 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:47.186594    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-sbhb4_2992e377-b62b-4fa7-a2ce-826fc6f74056/prometheus-operator/0.log"
Aug 04 01:01:47.217159 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:47.217133    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-sbhb4_2992e377-b62b-4fa7-a2ce-826fc6f74056/kube-rbac-proxy/0.log"
Aug 04 01:01:47.278808 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:47.278777    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9685c57b4-b9w68_e190f3cd-55a0-4492-ac8e-98c08d9e514d/telemeter-client/0.log"
Aug 04 01:01:47.302011 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:47.301987    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9685c57b4-b9w68_e190f3cd-55a0-4492-ac8e-98c08d9e514d/reload/0.log"
Aug 04 01:01:47.325830 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:47.325790    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9685c57b4-b9w68_e190f3cd-55a0-4492-ac8e-98c08d9e514d/kube-rbac-proxy/0.log"
Aug 04 01:01:47.359322 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:47.359295    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-775c96d4fb-n7l57_72f65aad-a515-4dc7-8f26-b87c3938268b/thanos-query/0.log"
Aug 04 01:01:47.389659 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:47.389626    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-775c96d4fb-n7l57_72f65aad-a515-4dc7-8f26-b87c3938268b/kube-rbac-proxy-web/0.log"
Aug 04 01:01:47.419026 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:47.418983    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-775c96d4fb-n7l57_72f65aad-a515-4dc7-8f26-b87c3938268b/kube-rbac-proxy/0.log"
Aug 04 01:01:47.445476 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:47.445448    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-775c96d4fb-n7l57_72f65aad-a515-4dc7-8f26-b87c3938268b/prom-label-proxy/0.log"
Aug 04 01:01:47.470686 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:47.470659    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-775c96d4fb-n7l57_72f65aad-a515-4dc7-8f26-b87c3938268b/kube-rbac-proxy-rules/0.log"
Aug 04 01:01:47.501323 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:47.501295    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-775c96d4fb-n7l57_72f65aad-a515-4dc7-8f26-b87c3938268b/kube-rbac-proxy-metrics/0.log"
Aug 04 01:01:49.525640 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:49.525598    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz"]
Aug 04 01:01:49.532479 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:49.532444    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz"
Aug 04 01:01:49.535896 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:49.535868    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6jcsw\"/\"default-dockercfg-jksch\""
Aug 04 01:01:49.537728 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:49.537690    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz"]
Aug 04 01:01:49.618232 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:49.618191    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d651b279-af1b-4391-b5c0-12058411126c-podres\") pod \"perf-node-gather-daemonset-s9plz\" (UID: \"d651b279-af1b-4391-b5c0-12058411126c\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz"
Aug 04 01:01:49.618424 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:49.618269    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjgfv\" (UniqueName: \"kubernetes.io/projected/d651b279-af1b-4391-b5c0-12058411126c-kube-api-access-cjgfv\") pod \"perf-node-gather-daemonset-s9plz\" (UID: \"d651b279-af1b-4391-b5c0-12058411126c\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz"
Aug 04 01:01:49.618424 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:49.618301    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d651b279-af1b-4391-b5c0-12058411126c-proc\") pod \"perf-node-gather-daemonset-s9plz\" (UID: \"d651b279-af1b-4391-b5c0-12058411126c\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz"
Aug 04 01:01:49.618424 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:49.618354    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d651b279-af1b-4391-b5c0-12058411126c-lib-modules\") pod \"perf-node-gather-daemonset-s9plz\" (UID: \"d651b279-af1b-4391-b5c0-12058411126c\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz"
Aug 04 01:01:49.618424 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:49.618388    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d651b279-af1b-4391-b5c0-12058411126c-sys\") pod \"perf-node-gather-daemonset-s9plz\" (UID: \"d651b279-af1b-4391-b5c0-12058411126c\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz"
Aug 04 01:01:49.719246 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:49.719201    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d651b279-af1b-4391-b5c0-12058411126c-proc\") pod \"perf-node-gather-daemonset-s9plz\" (UID: \"d651b279-af1b-4391-b5c0-12058411126c\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz"
Aug 04 01:01:49.719420 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:49.719301    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d651b279-af1b-4391-b5c0-12058411126c-lib-modules\") pod \"perf-node-gather-daemonset-s9plz\" (UID: \"d651b279-af1b-4391-b5c0-12058411126c\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz"
Aug 04 01:01:49.719420 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:49.719343    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d651b279-af1b-4391-b5c0-12058411126c-sys\") pod \"perf-node-gather-daemonset-s9plz\" (UID: \"d651b279-af1b-4391-b5c0-12058411126c\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz"
Aug 04 01:01:49.719551 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:49.719440    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d651b279-af1b-4391-b5c0-12058411126c-podres\") pod \"perf-node-gather-daemonset-s9plz\" (UID: \"d651b279-af1b-4391-b5c0-12058411126c\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz"
Aug 04 01:01:49.719551 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:49.719494    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d651b279-af1b-4391-b5c0-12058411126c-sys\") pod \"perf-node-gather-daemonset-s9plz\" (UID: \"d651b279-af1b-4391-b5c0-12058411126c\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz"
Aug 04 01:01:49.719551 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:49.719500    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjgfv\" (UniqueName: \"kubernetes.io/projected/d651b279-af1b-4391-b5c0-12058411126c-kube-api-access-cjgfv\") pod \"perf-node-gather-daemonset-s9plz\" (UID: \"d651b279-af1b-4391-b5c0-12058411126c\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz"
Aug 04 01:01:49.719733 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:49.719651    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d651b279-af1b-4391-b5c0-12058411126c-podres\") pod \"perf-node-gather-daemonset-s9plz\" (UID: \"d651b279-af1b-4391-b5c0-12058411126c\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz"
Aug 04 01:01:49.719805 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:49.719738    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d651b279-af1b-4391-b5c0-12058411126c-lib-modules\") pod \"perf-node-gather-daemonset-s9plz\" (UID: \"d651b279-af1b-4391-b5c0-12058411126c\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz"
Aug 04 01:01:49.719805 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:49.719770    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d651b279-af1b-4391-b5c0-12058411126c-proc\") pod \"perf-node-gather-daemonset-s9plz\" (UID: \"d651b279-af1b-4391-b5c0-12058411126c\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz"
Aug 04 01:01:49.728225 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:49.728197    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjgfv\" (UniqueName: \"kubernetes.io/projected/d651b279-af1b-4391-b5c0-12058411126c-kube-api-access-cjgfv\") pod \"perf-node-gather-daemonset-s9plz\" (UID: \"d651b279-af1b-4391-b5c0-12058411126c\") " pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz"
Aug 04 01:01:49.846367 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:49.846285    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6699cbcb6b-tkt8v_80f96fe0-858e-45ce-9fa6-f659a7365e97/console/0.log"
Aug 04 01:01:49.851172 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:49.851145    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz"
Aug 04 01:01:50.049124 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:50.048119    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz"]
Aug 04 01:01:50.545423 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:50.545290    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz" event={"ID":"d651b279-af1b-4391-b5c0-12058411126c","Type":"ContainerStarted","Data":"f7b5da5c5c30270a52fcc149cda6392cbe9c63b756f39b8bc4c91f1a26c6e512"}
Aug 04 01:01:50.545423 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:50.545357    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz" event={"ID":"d651b279-af1b-4391-b5c0-12058411126c","Type":"ContainerStarted","Data":"895d39386bc2d07020db6fa0938faa6107145d97b9de5a304f93876ef4feb1a8"}
Aug 04 01:01:50.545423 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:50.545405    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz"
Aug 04 01:01:50.564968 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:50.564907    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz" podStartSLOduration=1.564884979 podStartE2EDuration="1.564884979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 01:01:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 01:01:50.563200166 +0000 UTC m=+3564.731837537" watchObservedRunningTime="2026-08-04 01:01:50.564884979 +0000 UTC m=+3564.733522350"
Aug 04 01:01:51.843902 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:51.843874    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p75vz_05049a1e-914e-4f3a-977d-b26019f4cab7/dns/0.log"
Aug 04 01:01:51.869164 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:51.869138    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p75vz_05049a1e-914e-4f3a-977d-b26019f4cab7/kube-rbac-proxy/0.log"
Aug 04 01:01:51.946680 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:51.946653    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g8zpg_0311940e-8fe1-4dba-9f40-418274c065cc/dns-node-resolver/0.log"
Aug 04 01:01:52.575665 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:52.575627    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zw2l8_d0e3954b-476e-4ce8-a5e5-9364801153ed/node-ca/0.log"
Aug 04 01:01:53.530976 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:53.530949    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf_044a1248-d03f-4909-96b4-637aee3a2ebf/istio-proxy/0.log"
Aug 04 01:01:53.718572 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:53.718539    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57f7cf7b5f-9tfr9_cc1812f9-3025-4c7d-8841-479b66bd453a/kube-auth-proxy/0.log"
Aug 04 01:01:54.706373 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:54.706347    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c26k6_ab18aa19-3c52-4b0d-81ca-b492f1c1a2d3/serve-healthcheck-canary/0.log"
Aug 04 01:01:55.307912 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:55.307875    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cjtcl_e100a5f8-1a98-4c96-8dd5-0c490c60e06c/kube-rbac-proxy/0.log"
Aug 04 01:01:55.333317 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:55.333289    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cjtcl_e100a5f8-1a98-4c96-8dd5-0c490c60e06c/exporter/0.log"
Aug 04 01:01:55.365163 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:55.365131    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cjtcl_e100a5f8-1a98-4c96-8dd5-0c490c60e06c/extractor/0.log"
Aug 04 01:01:56.563802 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:56.563766    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6jcsw/perf-node-gather-daemonset-s9plz"
Aug 04 01:01:57.571621 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:57.571593    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-wv55h_d9eb0425-3fc2-42b2-89f4-edc38c47f37c/manager/0.log"
Aug 04 01:01:57.897117 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:57.897007    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-87768_0879b03f-6e77-4f5f-8a8a-8a07eb1c922d/manager/0.log"
Aug 04 01:01:58.185391 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:58.185292    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8594b76987-dvncd_df99b7ed-d36e-490e-87d4-53cb35e0ef95/manager/0.log"
Aug 04 01:01:58.210816 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:58.210785    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8594b76987-dvncd_df99b7ed-d36e-490e-87d4-53cb35e0ef95/copy-manifests/0.log"
Aug 04 01:01:59.611373 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:59.611268    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf_044a1248-d03f-4909-96b4-637aee3a2ebf/istio-proxy/0.log"
Aug 04 01:01:59.783594 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:59.783570    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57f7cf7b5f-9tfr9_cc1812f9-3025-4c7d-8841-479b66bd453a/kube-auth-proxy/0.log"
Aug 04 01:01:59.830514 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:01:59.830488    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-b745d77d5-rqlkq_8f3147fa-fab4-413c-8fcd-f1b180d40096/manager/0.log"
Aug 04 01:02:01.293879 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:02:01.293852    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cgh6jf_044a1248-d03f-4909-96b4-637aee3a2ebf/istio-proxy/0.log"
Aug 04 01:02:01.476473 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:02:01.476393    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57f7cf7b5f-9tfr9_cc1812f9-3025-4c7d-8841-479b66bd453a/kube-auth-proxy/0.log"
Aug 04 01:02:06.819829 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:02:06.819793    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sxn7d_4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a/kube-multus-additional-cni-plugins/0.log"
Aug 04 01:02:06.846313 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:02:06.846284    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sxn7d_4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a/egress-router-binary-copy/0.log"
Aug 04 01:02:06.869444 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:02:06.869409    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sxn7d_4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a/cni-plugins/0.log"
Aug 04 01:02:06.891637 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:02:06.891613    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sxn7d_4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a/bond-cni-plugin/0.log"
Aug 04 01:02:06.926948 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:02:06.926918    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sxn7d_4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a/routeoverride-cni/0.log"
Aug 04 01:02:06.948779 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:02:06.948752    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sxn7d_4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a/whereabouts-cni-bincopy/0.log"
Aug 04 01:02:06.970912 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:02:06.970889    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sxn7d_4ff6cd01-3ef7-4825-a025-5ecdfb00ba7a/whereabouts-cni/0.log"
Aug 04 01:02:07.013633 ip-10-0-143-2 kubenswrapper[2556]: I0804 01:02:07.013597    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sk5gb_542a9bb2-fa17-4f40-affd-3024a7968ec3/kube-multus/0.log"