Jul 22 20:54:46.564206 ip-10-0-133-4 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 22 20:54:46.564217 ip-10-0-133-4 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 22 20:54:46.564226 ip-10-0-133-4 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 22 20:54:46.564526 ip-10-0-133-4 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 22 20:54:56.466039 ip-10-0-133-4 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 22 20:54:56.466052 ip-10-0-133-4 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot b60bfbe222e14ce18cdbe43674c1f042 --
Jul 22 20:56:41.871407 ip-10-0-133-4 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 20:56:42.223769 ip-10-0-133-4 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 20:56:42.224207 ip-10-0-133-4 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 20:56:42.224207 ip-10-0-133-4 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 20:56:42.224207 ip-10-0-133-4 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 20:56:42.224207 ip-10-0-133-4 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 20:56:42.225445 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.225379    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 20:56:42.228881 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228866    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 20:56:42.228917 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228882    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 20:56:42.228917 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228888    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 20:56:42.228917 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228891    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 20:56:42.228917 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228895    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 20:56:42.228917 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228899    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 20:56:42.228917 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228904    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 20:56:42.228917 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228907    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 20:56:42.228917 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228910    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 20:56:42.228917 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228913    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 20:56:42.228917 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228916    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 20:56:42.228917 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228918    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 20:56:42.228917 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228922    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 20:56:42.228917 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228924    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 20:56:42.229242 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228927    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 20:56:42.229242 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228930    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 20:56:42.229242 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228932    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 20:56:42.229242 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228934    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 20:56:42.229242 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228937    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 20:56:42.229242 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228939    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 20:56:42.229242 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228942    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 20:56:42.229242 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228944    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 20:56:42.229242 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228947    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 20:56:42.229242 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228949    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 20:56:42.229242 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228952    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 20:56:42.229242 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228954    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 20:56:42.229242 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228957    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 20:56:42.229242 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228960    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 20:56:42.229242 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228962    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 20:56:42.229242 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228965    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 20:56:42.229242 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228968    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 20:56:42.229242 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228971    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 20:56:42.229242 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228975    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 20:56:42.229680 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228977    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 20:56:42.229680 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228980    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 20:56:42.229680 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228982    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 20:56:42.229680 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228985    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 20:56:42.229680 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228987    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 20:56:42.229680 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228990    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 20:56:42.229680 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228992    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 20:56:42.229680 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228994    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 20:56:42.229680 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.228996    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 20:56:42.229680 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229000    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 20:56:42.229680 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229002    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 20:56:42.229680 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229005    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 20:56:42.229680 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229007    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 20:56:42.229680 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229010    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 20:56:42.229680 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229013    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 20:56:42.229680 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229015    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 20:56:42.229680 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229018    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 20:56:42.229680 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229021    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 20:56:42.229680 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229023    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 20:56:42.229680 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229025    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 20:56:42.230168 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229028    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 20:56:42.230168 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229030    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 20:56:42.230168 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229033    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 20:56:42.230168 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229035    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 20:56:42.230168 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229038    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 20:56:42.230168 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229040    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 20:56:42.230168 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229042    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 20:56:42.230168 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229045    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 20:56:42.230168 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229047    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 20:56:42.230168 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229050    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 20:56:42.230168 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229052    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 20:56:42.230168 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229054    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 20:56:42.230168 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229057    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 20:56:42.230168 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229059    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 20:56:42.230168 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229061    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 20:56:42.230168 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229064    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 20:56:42.230168 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229066    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 20:56:42.230168 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229068    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 20:56:42.230168 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229071    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 20:56:42.230614 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229073    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 20:56:42.230614 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229075    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 20:56:42.230614 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229078    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 20:56:42.230614 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229080    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 20:56:42.230614 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229083    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 20:56:42.230614 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229086    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 20:56:42.230614 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229088    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 20:56:42.230614 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229092    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 20:56:42.230614 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229095    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 20:56:42.230614 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229098    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 20:56:42.230614 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229100    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 20:56:42.230614 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229103    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 20:56:42.230614 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229118    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 20:56:42.230614 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229121    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 20:56:42.230614 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229124    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 20:56:42.230614 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229126    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 20:56:42.230614 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229129    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 20:56:42.230614 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229131    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 20:56:42.230614 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229134    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 20:56:42.230614 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229136    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 20:56:42.231086 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229138    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 20:56:42.231086 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229141    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 20:56:42.231086 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229143    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 20:56:42.231086 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229146    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 20:56:42.231086 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229148    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 20:56:42.231086 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229150    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 20:56:42.231086 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229153    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 20:56:42.231086 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229824    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 20:56:42.231086 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229830    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 20:56:42.231086 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229833    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 20:56:42.231086 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229836    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 20:56:42.231086 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229838    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 20:56:42.231086 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229841    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 20:56:42.231086 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229843    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 20:56:42.231086 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229846    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 20:56:42.231086 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229848    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 20:56:42.231086 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229852    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 20:56:42.231086 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229854    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 20:56:42.231086 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229856    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 20:56:42.231086 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229860    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 20:56:42.231611 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229862    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 20:56:42.231611 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229865    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 20:56:42.231611 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229867    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 20:56:42.231611 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229870    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 20:56:42.231611 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229872    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 20:56:42.231611 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229874    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 20:56:42.231611 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229877    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 20:56:42.231611 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229880    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 20:56:42.231611 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229882    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 20:56:42.231611 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229884    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 20:56:42.231611 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229887    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 20:56:42.231611 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229889    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 20:56:42.231611 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229892    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 20:56:42.231611 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229894    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 20:56:42.231611 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229897    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 20:56:42.231611 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229899    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 20:56:42.231611 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229902    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 20:56:42.231611 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229904    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 20:56:42.231611 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229907    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 20:56:42.232069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229909    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 20:56:42.232069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229912    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 20:56:42.232069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229914    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 20:56:42.232069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229917    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 20:56:42.232069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229919    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 20:56:42.232069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229922    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 20:56:42.232069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229925    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 20:56:42.232069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229928    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 20:56:42.232069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229930    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 20:56:42.232069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229934    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 20:56:42.232069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229938    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 20:56:42.232069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229940    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 20:56:42.232069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229943    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 20:56:42.232069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229945    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 20:56:42.232069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229948    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 20:56:42.232069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229950    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 20:56:42.232069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229952    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 20:56:42.232069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229955    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 20:56:42.232069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229957    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 20:56:42.232069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229959    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 20:56:42.232615 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229962    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 20:56:42.232615 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229964    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 20:56:42.232615 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229967    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 20:56:42.232615 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229969    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 20:56:42.232615 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229971    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 20:56:42.232615 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229974    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 20:56:42.232615 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229977    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 20:56:42.232615 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229979    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 20:56:42.232615 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229981    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 20:56:42.232615 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229984    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 20:56:42.232615 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229986    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 20:56:42.232615 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229988    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 20:56:42.232615 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229991    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 20:56:42.232615 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229993    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 20:56:42.232615 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229995    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 20:56:42.232615 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.229998    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 20:56:42.232615 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230000    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 20:56:42.232615 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230003    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 20:56:42.232615 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230006    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 20:56:42.232615 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230009    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 20:56:42.233150 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230011    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 20:56:42.233150 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230014    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 20:56:42.233150 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230016    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 20:56:42.233150 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230021    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 20:56:42.233150 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230025    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 20:56:42.233150 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230028    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 20:56:42.233150 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230031    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 20:56:42.233150 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230034    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 20:56:42.233150 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230037    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 20:56:42.233150 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230039    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 20:56:42.233150 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230042    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 20:56:42.233150 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230045    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 20:56:42.233150 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230050    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 20:56:42.233150 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230052    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 20:56:42.233150 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230055    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 20:56:42.233150 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230057    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 20:56:42.233150 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230060    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 20:56:42.233150 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230064    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 20:56:42.233150 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230067    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 20:56:42.233598 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230070    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 20:56:42.233598 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230073    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 20:56:42.233598 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230075    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 20:56:42.233598 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230078    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 20:56:42.233598 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230081    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 20:56:42.233598 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230084    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 20:56:42.233598 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230086    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 20:56:42.233598 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230089    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 20:56:42.233598 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230459    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 20:56:42.233598 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230465    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 20:56:42.233598 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230468    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 20:56:42.233598 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230471    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 20:56:42.233598 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230474    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 20:56:42.233598 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230477    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 20:56:42.233598 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230480    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 20:56:42.233598 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230483    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 20:56:42.233598 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230486    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 20:56:42.233598 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230489    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 20:56:42.233598 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230491    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 20:56:42.233598 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230494    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 20:56:42.234069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230496    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 20:56:42.234069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230499    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 20:56:42.234069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230501    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 20:56:42.234069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230504    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 20:56:42.234069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230506    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 20:56:42.234069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230510    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 20:56:42.234069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230513    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 20:56:42.234069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230516    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 20:56:42.234069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230518    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 20:56:42.234069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230521    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 20:56:42.234069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230523    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 20:56:42.234069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230525    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 20:56:42.234069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230528    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 20:56:42.234069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230531    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 20:56:42.234069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230533    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 20:56:42.234069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230535    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 20:56:42.234069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230538    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 20:56:42.234069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230540    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 20:56:42.234069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230542    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 20:56:42.234069 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230545    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 20:56:42.234568 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230547    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 20:56:42.234568 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230550    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 20:56:42.234568 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230552    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 20:56:42.234568 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230554    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 20:56:42.234568 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230558    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 20:56:42.234568 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230561    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 20:56:42.234568 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230563    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 20:56:42.234568 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230566    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 20:56:42.234568 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230568    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 20:56:42.234568 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230571    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 20:56:42.234568 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230573    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 20:56:42.234568 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230576    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 20:56:42.234568 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230578    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 20:56:42.234568 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230581    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 20:56:42.234568 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230583    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 20:56:42.234568 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230592    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 20:56:42.234568 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230594    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 20:56:42.234568 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230598    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 20:56:42.234568 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230600    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 20:56:42.234568 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230603    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 20:56:42.235036 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230605    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 20:56:42.235036 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230607    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 20:56:42.235036 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230610    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 20:56:42.235036 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230612    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 20:56:42.235036 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230615    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 20:56:42.235036 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230618    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 20:56:42.235036 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230620    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 20:56:42.235036 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230623    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 20:56:42.235036 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230625    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 20:56:42.235036 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230628    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 20:56:42.235036 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230630    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 20:56:42.235036 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230634    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 20:56:42.235036 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230638    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 20:56:42.235036 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230641    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 20:56:42.235036 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230644    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 20:56:42.235036 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230647    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 20:56:42.235036 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230651    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 20:56:42.235036 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230654    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 20:56:42.235036 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230657    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 20:56:42.235514 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230660    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 20:56:42.235514 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230662    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 20:56:42.235514 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230665    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 20:56:42.235514 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230668    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 20:56:42.235514 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230672    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 20:56:42.235514 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230674    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 20:56:42.235514 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230677    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 20:56:42.235514 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230679    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 20:56:42.235514 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230682    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 20:56:42.235514 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230684    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 20:56:42.235514 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230687    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 20:56:42.235514 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230690    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 20:56:42.235514 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230692    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 20:56:42.235514 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230695    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 20:56:42.235514 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230698    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 20:56:42.235514 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230701    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 20:56:42.235514 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230705    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 20:56:42.235514 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230708    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 20:56:42.235514 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230710    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 20:56:42.235514 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230713    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 20:56:42.235987 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230715    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 20:56:42.235987 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230719    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 20:56:42.235987 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230722    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 20:56:42.235987 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230725    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 20:56:42.235987 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230728    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 20:56:42.235987 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230730    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 20:56:42.235987 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230733    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 20:56:42.235987 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.230736    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 20:56:42.235987 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230803    2583 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 20:56:42.235987 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230811    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 20:56:42.235987 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230817    2583 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 20:56:42.235987 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230821    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 20:56:42.235987 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230825    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 20:56:42.235987 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230828    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 20:56:42.235987 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230831    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 20:56:42.235987 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230835    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 20:56:42.235987 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230839    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 20:56:42.235987 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230842    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 20:56:42.235987 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230845    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 20:56:42.235987 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230848    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 20:56:42.235987 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230851    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230854    2583 flags.go:64] FLAG: --cgroup-root=""
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230857    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230860    2583 flags.go:64] FLAG: --client-ca-file=""
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230862    2583 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230865    2583 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230868    2583 flags.go:64] FLAG: --cluster-domain=""
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230871    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230874    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230877    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230880    2583 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230883    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230886    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230888    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230891    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230894    2583 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230897    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230900    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230903    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230905    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230909    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230913    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230915    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230918    2583 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230921    2583 flags.go:64] FLAG: --enable-server="true"
Jul 22 20:56:42.236531 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230924    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230928    2583 flags.go:64] FLAG: --event-burst="100"
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230932    2583 flags.go:64] FLAG: --event-qps="50"
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230934    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230937    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230940    2583 flags.go:64] FLAG: --eviction-hard=""
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230944    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230947    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230949    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230952    2583 flags.go:64] FLAG: --eviction-soft=""
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230955    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230958    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230961    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230963    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230966    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230969    2583 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230972    2583 flags.go:64] FLAG: --feature-gates=""
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230975    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230978    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230980    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230983    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230986    2583 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230989    2583 flags.go:64] FLAG: --help="false"
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230992    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-133-4.ec2.internal"
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230994    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 20:56:42.237135 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.230997    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 20:56:42.237781 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231000    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 20:56:42.237781 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231003    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 20:56:42.237781 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231008    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 20:56:42.237781 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231011    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 20:56:42.237781 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231013    2583 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 20:56:42.237781 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231016    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 20:56:42.237781 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231018    2583 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 20:56:42.237781 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231022    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 20:56:42.237781 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231024    2583 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 20:56:42.237781 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231027    2583 flags.go:64] FLAG: --kube-reserved=""
Jul 22 20:56:42.237781 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231029    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 20:56:42.237781 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231032    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 20:56:42.237781 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231035    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 20:56:42.237781 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231038    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 20:56:42.237781 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231040    2583 flags.go:64] FLAG: --lock-file=""
Jul 22 20:56:42.237781 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231043    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 20:56:42.237781 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231046    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 20:56:42.237781 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231049    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 20:56:42.237781 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231054    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 20:56:42.237781 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231056    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 20:56:42.237781 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231059    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 20:56:42.237781 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231061    2583 flags.go:64] FLAG: --logging-format="text"
Jul 22 20:56:42.237781 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231064    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 20:56:42.238358 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231067    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 20:56:42.238358 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231070    2583 flags.go:64] FLAG: --manifest-url=""
Jul 22 20:56:42.238358 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231072    2583 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 20:56:42.238358 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231077    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 20:56:42.238358 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231079    2583 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 20:56:42.238358 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231083    2583 flags.go:64] FLAG: --max-pods="110"
Jul 22 20:56:42.238358 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231086    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 20:56:42.238358 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231089    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 20:56:42.238358 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231091    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 20:56:42.238358 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231094    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 20:56:42.238358 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231097    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 20:56:42.238358 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231101    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 20:56:42.238358 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231123    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 20:56:42.238358 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231140    2583 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 20:56:42.238358 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231143    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 20:56:42.238358 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231146    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 20:56:42.238358 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231149    2583 flags.go:64] FLAG: --pod-cidr=""
Jul 22 20:56:42.238358 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231152    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 20:56:42.238358 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231157    2583 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 20:56:42.238358 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231160    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 20:56:42.238358 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231163    2583 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 20:56:42.238358 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231167    2583 flags.go:64] FLAG: --port="10250"
Jul 22 20:56:42.238358 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231170    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 20:56:42.238358 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231172    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c43c60771d22894f"
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231175    2583 flags.go:64] FLAG: --qos-reserved=""
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231178    2583 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231181    2583 flags.go:64] FLAG: --register-node="true"
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231183    2583 flags.go:64] FLAG: --register-with-taints=""
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231191    2583 flags.go:64] FLAG: --registry-burst="10"
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231194    2583 flags.go:64] FLAG: --registry-qps="5"
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231197    2583 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231200    2583 flags.go:64] FLAG: --reserved-memory=""
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231203    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231206    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231209    2583 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231212    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231214    2583 flags.go:64] FLAG: --runonce="false"
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231217    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231220    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231223    2583 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231225    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231228    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231231    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231234    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231237    2583 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231241    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231244    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231247    2583 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231249    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 20:56:42.239051 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231252    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 20:56:42.239695 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231255    2583 flags.go:64] FLAG: --system-cgroups=""
Jul 22 20:56:42.239695 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231257    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 20:56:42.239695 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231262    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 20:56:42.239695 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231265    2583 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 20:56:42.239695 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231268    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 20:56:42.239695 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231272    2583 flags.go:64] FLAG: --tls-min-version=""
Jul 22 20:56:42.239695 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231274    2583 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 20:56:42.239695 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231277    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 20:56:42.239695 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231279    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 20:56:42.239695 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231282    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 20:56:42.239695 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231285    2583 flags.go:64] FLAG: --v="2"
Jul 22 20:56:42.239695 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231288    2583 flags.go:64] FLAG: --version="false"
Jul 22 20:56:42.239695 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231292    2583 flags.go:64] FLAG: --vmodule=""
Jul 22 20:56:42.239695 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231295    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 20:56:42.239695 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231298    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 20:56:42.239695 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231404    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 20:56:42.239695 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231408    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 20:56:42.239695 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231410    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 20:56:42.239695 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231413    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 20:56:42.239695 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231416    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 20:56:42.239695 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231420    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 20:56:42.239695 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231423    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 20:56:42.239695 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231426    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 20:56:42.240260 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231429    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 20:56:42.240260 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231431    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 20:56:42.240260 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231434    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 20:56:42.240260 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231436    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 20:56:42.240260 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231440    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 20:56:42.240260 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231442    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 20:56:42.240260 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231445    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 20:56:42.240260 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231447    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 20:56:42.240260 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231450    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 20:56:42.240260 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231452    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 20:56:42.240260 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231454    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 20:56:42.240260 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231457    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 20:56:42.240260 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231459    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 20:56:42.240260 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231461    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 20:56:42.240260 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231464    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 20:56:42.240260 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231468    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 20:56:42.240260 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231471    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 20:56:42.240260 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231473    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 20:56:42.240260 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231476    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 20:56:42.240260 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231478    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 20:56:42.240753 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231480    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 20:56:42.240753 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231483    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 20:56:42.240753 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231485    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 20:56:42.240753 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231488    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 20:56:42.240753 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231490    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 20:56:42.240753 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231493    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 20:56:42.240753 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231495    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 20:56:42.240753 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231497    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 20:56:42.240753 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231500    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 20:56:42.240753 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231502    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 20:56:42.240753 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231504    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 20:56:42.240753 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231507    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 20:56:42.240753 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231509    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 20:56:42.240753 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231511    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 20:56:42.240753 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231514    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 20:56:42.240753 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231516    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 20:56:42.240753 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231521    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 20:56:42.240753 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231523    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 20:56:42.240753 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231526    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 20:56:42.240753 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231528    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 20:56:42.241235 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231530    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 20:56:42.241235 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231533    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 20:56:42.241235 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231536    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 20:56:42.241235 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231539    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 20:56:42.241235 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231542    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 20:56:42.241235 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231545    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 20:56:42.241235 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231548    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 20:56:42.241235 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231551    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 20:56:42.241235 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231553    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 20:56:42.241235 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231556    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 20:56:42.241235 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231558    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 20:56:42.241235 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231560    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 20:56:42.241235 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231562    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 20:56:42.241235 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231565    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 20:56:42.241235 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231567    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 20:56:42.241235 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231569    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 20:56:42.241235 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231572    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 20:56:42.241235 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231574    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 20:56:42.241235 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231576    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 20:56:42.241726 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231579    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 20:56:42.241726 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231581    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 20:56:42.241726 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231584    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 20:56:42.241726 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231586    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 20:56:42.241726 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231588    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 20:56:42.241726 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231591    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 20:56:42.241726 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231593    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 20:56:42.241726 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231595    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 20:56:42.241726 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231598    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 20:56:42.241726 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231602    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 20:56:42.241726 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231605    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 20:56:42.241726 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231607    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 20:56:42.241726 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231609    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 20:56:42.241726 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231612    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 20:56:42.241726 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231614    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 20:56:42.241726 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231617    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 20:56:42.241726 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231619    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 20:56:42.241726 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231622    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 20:56:42.241726 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231624    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 20:56:42.241726 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231627    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 20:56:42.242227 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231629    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 20:56:42.242227 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231632    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 20:56:42.242227 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231634    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 20:56:42.242227 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231636    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 20:56:42.242227 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231639    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 20:56:42.242227 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231641    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 20:56:42.242227 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231644    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 20:56:42.242227 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231646    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 20:56:42.242227 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231648    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 20:56:42.242227 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231650    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 20:56:42.242227 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231653    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 20:56:42.242227 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.231655    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 20:56:42.242227 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.231660    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 20:56:42.242227 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.237916    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 20:56:42.242227 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.237930    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 20:56:42.242599 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.238663    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 20:56:42.242599 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.238670    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 20:56:42.242599 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238731    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 20:56:42.242599 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238736    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 20:56:42.242599 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238740    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 20:56:42.242599 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238743    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 20:56:42.242599 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238745    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 20:56:42.242599 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238748    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 20:56:42.242599 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238751    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 20:56:42.242599 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238754    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 20:56:42.242599 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238756    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 20:56:42.242599 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238760    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 20:56:42.242599 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238764    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 20:56:42.242599 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238767    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 20:56:42.242599 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238770    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 20:56:42.242599 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238773    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 20:56:42.242599 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238776    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 20:56:42.242599 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238778    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 20:56:42.243029 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238782    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 20:56:42.243029 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238785    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 20:56:42.243029 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238787    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 20:56:42.243029 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238791    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 20:56:42.243029 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238794    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 20:56:42.243029 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238797    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 20:56:42.243029 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238800    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 20:56:42.243029 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238803    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 20:56:42.243029 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238805    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 20:56:42.243029 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238808    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 20:56:42.243029 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238810    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 20:56:42.243029 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238812    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 20:56:42.243029 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238815    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 20:56:42.243029 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238818    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 20:56:42.243029 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238821    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 20:56:42.243029 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238824    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 20:56:42.243029 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238826    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 20:56:42.243029 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238830    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 20:56:42.243029 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238833    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 20:56:42.243560 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238836    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 20:56:42.243560 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238839    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 20:56:42.243560 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238841    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 20:56:42.243560 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238844    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 20:56:42.243560 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238847    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 20:56:42.243560 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238849    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 20:56:42.243560 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238852    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 20:56:42.243560 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238854    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 20:56:42.243560 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238856    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 20:56:42.243560 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238859    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 20:56:42.243560 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238861    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 20:56:42.243560 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238864    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 20:56:42.243560 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238867    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 20:56:42.243560 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238869    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 20:56:42.243560 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238872    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 20:56:42.243560 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238875    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 20:56:42.243560 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238878    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 20:56:42.243560 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238881    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 20:56:42.243560 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238883    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 20:56:42.243560 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238886    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 20:56:42.244022 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238888    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 20:56:42.244022 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238890    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 20:56:42.244022 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238893    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 20:56:42.244022 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238897    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 20:56:42.244022 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238900    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 20:56:42.244022 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238902    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 20:56:42.244022 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238905    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 20:56:42.244022 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238907    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 20:56:42.244022 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238910    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 20:56:42.244022 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238912    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 20:56:42.244022 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238915    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 20:56:42.244022 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238917    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 20:56:42.244022 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238920    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 20:56:42.244022 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238922    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 20:56:42.244022 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238925    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 20:56:42.244022 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238927    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 20:56:42.244022 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238930    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 20:56:42.244022 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238932    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 20:56:42.244022 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238934    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 20:56:42.244022 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238937    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 20:56:42.244517 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238940    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 20:56:42.244517 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238942    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 20:56:42.244517 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238944    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 20:56:42.244517 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238947    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 20:56:42.244517 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238949    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 20:56:42.244517 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238951    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 20:56:42.244517 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238954    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 20:56:42.244517 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238957    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 20:56:42.244517 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238959    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 20:56:42.244517 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238962    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 20:56:42.244517 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238964    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 20:56:42.244517 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238966    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 20:56:42.244517 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238969    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 20:56:42.244517 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238971    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 20:56:42.244517 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238974    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 20:56:42.244517 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238976    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 20:56:42.244517 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238978    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 20:56:42.244517 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238981    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 20:56:42.244517 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238984    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 20:56:42.244517 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238986    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 20:56:42.244987 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238989    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 20:56:42.244987 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238991    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 20:56:42.244987 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238994    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 20:56:42.244987 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.238996    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 20:56:42.244987 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.239001    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 20:56:42.244987 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239119    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 20:56:42.244987 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239125    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 20:56:42.244987 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239128    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 20:56:42.244987 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239131    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 20:56:42.244987 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239133    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 20:56:42.244987 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239136    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 20:56:42.244987 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239139    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 20:56:42.244987 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239141    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 20:56:42.244987 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239144    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 20:56:42.244987 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239146    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 20:56:42.245397 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239149    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 20:56:42.245397 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239151    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 20:56:42.245397 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239154    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 20:56:42.245397 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239156    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 20:56:42.245397 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239159    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 20:56:42.245397 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239162    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 20:56:42.245397 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239164    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 20:56:42.245397 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239167    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 20:56:42.245397 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239169    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 20:56:42.245397 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239172    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 20:56:42.245397 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239174    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 20:56:42.245397 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239177    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 20:56:42.245397 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239179    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 20:56:42.245397 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239181    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 20:56:42.245397 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239184    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 20:56:42.245397 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239186    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 20:56:42.245397 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239189    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 20:56:42.245397 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239192    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 20:56:42.245397 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239195    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 20:56:42.245397 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239197    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 20:56:42.245879 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239199    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 20:56:42.245879 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239202    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 20:56:42.245879 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239206    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 20:56:42.245879 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239210    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 20:56:42.245879 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239212    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 20:56:42.245879 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239215    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 20:56:42.245879 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239218    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 20:56:42.245879 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239221    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 20:56:42.245879 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239223    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 20:56:42.245879 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239226    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 20:56:42.245879 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239228    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 20:56:42.245879 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239230    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 20:56:42.245879 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239233    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 20:56:42.245879 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239235    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 20:56:42.245879 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239239    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 20:56:42.245879 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239242    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 20:56:42.245879 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239244    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 20:56:42.245879 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239247    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 20:56:42.246371 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239249    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 20:56:42.246371 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239252    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 20:56:42.246371 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239254    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 20:56:42.246371 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239256    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 20:56:42.246371 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239259    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 20:56:42.246371 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239261    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 20:56:42.246371 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239264    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 20:56:42.246371 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239266    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 20:56:42.246371 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239269    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 20:56:42.246371 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239271    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 20:56:42.246371 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239274    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 20:56:42.246371 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239276    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 20:56:42.246371 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239278    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 20:56:42.246371 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239281    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 20:56:42.246371 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239284    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 20:56:42.246371 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239286    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 20:56:42.246371 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239288    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 20:56:42.246371 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239291    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 20:56:42.246371 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239293    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 20:56:42.246371 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239296    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 20:56:42.247163 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239298    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 20:56:42.247163 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239301    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 20:56:42.247163 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239303    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 20:56:42.247163 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239305    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 20:56:42.247163 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239307    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 20:56:42.247163 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239310    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 20:56:42.247163 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239314    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 20:56:42.247163 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239317    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 20:56:42.247163 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239319    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 20:56:42.247163 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239322    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 20:56:42.247163 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239325    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 20:56:42.247163 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239327    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 20:56:42.247163 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239330    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 20:56:42.247163 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239333    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 20:56:42.247163 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239336    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 20:56:42.247163 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239339    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 20:56:42.247163 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239341    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 20:56:42.247163 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239343    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 20:56:42.247163 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239346    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 20:56:42.247163 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239348    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 20:56:42.247759 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239351    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 20:56:42.247759 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239353    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 20:56:42.247759 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239356    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 20:56:42.247759 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239358    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 20:56:42.247759 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239361    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 20:56:42.247759 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239364    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 20:56:42.247759 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239366    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 20:56:42.247759 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239368    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 20:56:42.247759 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239370    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 20:56:42.247759 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239373    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 20:56:42.247759 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:42.239375    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 20:56:42.247759 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.239380    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 20:56:42.247759 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.239472    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 20:56:42.247759 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.241550    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 20:56:42.247759 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.242857    2583 server.go:1019] "Starting client certificate rotation"
Jul 22 20:56:42.248234 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.242953    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 20:56:42.248234 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.242998    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 20:56:42.248234 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.245138    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 20:56:42.248234 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.246909    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 20:56:42.259550 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.259534    2583 log.go:25] "Validated CRI v1 runtime API"
Jul 22 20:56:42.261567 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.261552    2583 log.go:25] "Validated CRI v1 image API"
Jul 22 20:56:42.262404 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.262387    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 20:56:42.265661 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.265643    2583 fs.go:135] Filesystem UUIDs: map[716abfb4-69b5-4fac-bfdf-1d361bfda1c2:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 969d3fbb-eb76-4c82-82d6-165c68a1d0fe:/dev/nvme0n1p4]
Jul 22 20:56:42.265710 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.265663    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 20:56:42.270317 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.270213    2583 manager.go:216] Machine: {Timestamp:2026-07-22 20:56:42.269086217 +0000 UTC m=+0.293124788 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3123598 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2eee350ef82db2d3258eea058da7ef SystemUUID:ec2eee35-0ef8-2db2-d325-8eea058da7ef BootID:b60bfbe2-22e1-4ce1-8cdb-e43674c1f042 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ab:3a:c9:3c:23 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ab:3a:c9:3c:23 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:1e:5e:50:c5:2e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 20:56:42.270317 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.270313    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 20:56:42.270417 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.270379    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 20:56:42.272069 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.272055    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 20:56:42.273346 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.273319    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 20:56:42.273479 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.273350    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-4.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 20:56:42.274144 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.274134    2583 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 20:56:42.274175 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.274147    2583 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 20:56:42.274175 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.274154    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 20:56:42.274823 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.274813    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 20:56:42.276270 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.276260    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 20:56:42.280363 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.280351    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 20:56:42.280472 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.280463    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 20:56:42.280510 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.280492    2583 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 20:56:42.280510 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.280503    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 20:56:42.280583 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.280515    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 20:56:42.280583 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.280524    2583 kubelet.go:398] "Adding apiserver pod source"
Jul 22 20:56:42.280583 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.280532    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 20:56:42.280835 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.280823    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 20:56:42.280867 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.280841    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 20:56:42.282841 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.282822    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 20:56:42.284390 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.284375    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 20:56:42.284448 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.284406    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 20:56:42.285093 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.285076    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 20:56:42.285151 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.285126    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 20:56:42.285151 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.285135    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 20:56:42.285151 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.285140    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 20:56:42.285151 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.285148    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 20:56:42.285151 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.285153    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 20:56:42.285286 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.285161    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 20:56:42.285286 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.285165    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 20:56:42.285286 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.285173    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 20:56:42.285286 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.285178    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 20:56:42.285286 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.285186    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 20:56:42.285286 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.285190    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 20:56:42.285848 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.285839    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 20:56:42.285848 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.285848    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 20:56:42.290128 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.290089    2583 server.go:1268] "Started kubelet"
Jul 22 20:56:42.290212 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.290163    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 20:56:42.290462 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.290308    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 20:56:42.290462 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.290374    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 20:56:42.291026 ip-10-0-133-4 systemd[1]: Started Kubernetes Kubelet.
Jul 22 20:56:42.291811 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.291798    2583 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 20:56:42.291966 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.291926    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 20:56:42.292139 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.292124    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-4.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 20:56:42.292193 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:42.292155    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 22 20:56:42.292242 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:42.292212    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-4.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 20:56:42.294137 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:42.294094    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 20:56:42.297581 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:42.296717    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-4.ec2.internal.18c4b8208d06c7d0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-4.ec2.internal,UID:ip-10-0-133-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-4.ec2.internal,},FirstTimestamp:2026-07-22 20:56:42.29005512 +0000 UTC m=+0.314093690,LastTimestamp:2026-07-22 20:56:42.29005512 +0000 UTC m=+0.314093690,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-4.ec2.internal,}"
Jul 22 20:56:42.298951 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.298934    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 20:56:42.299039 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.299002    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 20:56:42.299324 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:42.299301    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found"
Jul 22 20:56:42.299585 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.299566    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 20:56:42.299585 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.299585    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 20:56:42.299723 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.299566    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 20:56:42.299723 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.299695    2583 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 20:56:42.299723 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.299704    2583 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 20:56:42.299994 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.299905    2583 factory.go:55] Registering systemd factory
Jul 22 20:56:42.300085 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.300019    2583 factory.go:223] Registration of the systemd container factory successfully
Jul 22 20:56:42.300247 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.300236    2583 factory.go:153] Registering CRI-O factory
Jul 22 20:56:42.300294 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.300249    2583 factory.go:223] Registration of the crio container factory successfully
Jul 22 20:56:42.300329 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.300297    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 20:56:42.300329 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.300318    2583 factory.go:103] Registering Raw factory
Jul 22 20:56:42.300329 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.300328    2583 manager.go:1196] Started watching for new ooms in manager
Jul 22 20:56:42.300861 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.300848    2583 manager.go:349] Starting recovery of all containers
Jul 22 20:56:42.304075 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:42.304044    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 22 20:56:42.304075 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:42.304062    2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-4.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 22 20:56:42.311286 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.311146    2583 manager.go:354] Recovery completed
Jul 22 20:56:42.313494 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:42.313476    2583 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 22 20:56:42.316482 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.316471    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 20:56:42.318692 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.318673    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 20:56:42.318767 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.318706    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 20:56:42.318767 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.318719    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientPID"
Jul 22 20:56:42.319270 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.319257    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 20:56:42.319270 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.319270    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 20:56:42.319340 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.319284    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 20:56:42.319393 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.319269    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 20:56:42.320029 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.320016    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 20:56:42.320090 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.320039    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 20:56:42.320090 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.320048    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientPID"
Jul 22 20:56:42.320654 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:42.320598    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-4.ec2.internal.18c4b8208ebbb8cd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-4.ec2.internal,UID:ip-10-0-133-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-4.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-4.ec2.internal,},FirstTimestamp:2026-07-22 20:56:42.318690509 +0000 UTC m=+0.342729082,LastTimestamp:2026-07-22 20:56:42.318690509 +0000 UTC m=+0.342729082,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-4.ec2.internal,}"
Jul 22 20:56:42.321404 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.321391    2583 policy_none.go:49] "None policy: Start"
Jul 22 20:56:42.321438 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.321407    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 20:56:42.321438 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.321418    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 20:56:42.322648 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.322634    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fmcbg"
Jul 22 20:56:42.323378 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.323367    2583 policy_none.go:47] "Start"
Jul 22 20:56:42.330460 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:42.330401    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-4.ec2.internal.18c4b8208ebc11b8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-4.ec2.internal,UID:ip-10-0-133-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-4.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-4.ec2.internal,},FirstTimestamp:2026-07-22 20:56:42.318713272 +0000 UTC m=+0.342751848,LastTimestamp:2026-07-22 20:56:42.318713272 +0000 UTC m=+0.342751848,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-4.ec2.internal,}"
Jul 22 20:56:42.330949 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.330934    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fmcbg"
Jul 22 20:56:42.355427 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.355414    2583 manager.go:337] "Starting Device Plugin manager"
Jul 22 20:56:42.355522 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:42.355452    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 20:56:42.355522 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.355466    2583 server.go:87] "Starting device plugin registration server"
Jul 22 20:56:42.355688 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.355675    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 20:56:42.355740 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.355689    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 20:56:42.355812 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.355799    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 20:56:42.355946 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.355903    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 20:56:42.355946 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.355914    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 20:56:42.356387 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:42.356366    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 20:56:42.356451 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:42.356421    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-4.ec2.internal\" not found"
Jul 22 20:56:42.402149 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.402121    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 20:56:42.408837 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.403329    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 20:56:42.408837 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.403358    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 20:56:42.408837 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.403373    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 20:56:42.408837 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:42.403399    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 20:56:42.408837 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.405924    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 20:56:42.456525 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.456508    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 20:56:42.457308 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.457293    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 20:56:42.457376 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.457319    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 20:56:42.457376 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.457328    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientPID"
Jul 22 20:56:42.457376 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.457357    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-4.ec2.internal"
Jul 22 20:56:42.466169 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.466152    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-4.ec2.internal"
Jul 22 20:56:42.466237 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:42.466171    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-4.ec2.internal\": node \"ip-10-0-133-4.ec2.internal\" not found"
Jul 22 20:56:42.489537 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:42.489496    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found"
Jul 22 20:56:42.503809 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.503792    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-4.ec2.internal"]
Jul 22 20:56:42.503918 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.503842    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 20:56:42.505256 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.505236    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 20:56:42.505348 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.505264    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 20:56:42.505348 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.505277    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientPID"
Jul 22 20:56:42.507596 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.507581    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 20:56:42.507700 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.507686    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal"
Jul 22 20:56:42.507744 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.507714    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 20:56:42.508244 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.508225    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 20:56:42.508336 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.508256    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 20:56:42.508336 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.508266    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientPID"
Jul 22 20:56:42.508336 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.508318    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 20:56:42.508437 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.508337    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 20:56:42.508437 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.508351    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientPID"
Jul 22 20:56:42.510502 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.510485    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-4.ec2.internal"
Jul 22 20:56:42.510571 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.510510    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 20:56:42.511148 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.511133    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 20:56:42.511238 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.511158    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 20:56:42.511238 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.511168    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientPID"
Jul 22 20:56:42.536691 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:42.536667    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-4.ec2.internal\" not found" node="ip-10-0-133-4.ec2.internal"
Jul 22 20:56:42.540826 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:42.540810    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-4.ec2.internal\" not found" node="ip-10-0-133-4.ec2.internal"
Jul 22 20:56:42.590587 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:42.590569    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found"
Jul 22 20:56:42.601451 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.601432    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9edba1956cde62e13c8b32ed8cb33678-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal\" (UID: \"9edba1956cde62e13c8b32ed8cb33678\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal"
Jul 22 20:56:42.601496 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.601456    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9edba1956cde62e13c8b32ed8cb33678-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal\" (UID: \"9edba1956cde62e13c8b32ed8cb33678\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal"
Jul 22 20:56:42.601496 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.601473    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee01c9b5f7069f2b2a4c40086f314e75-config\") pod \"kube-apiserver-proxy-ip-10-0-133-4.ec2.internal\" (UID: \"ee01c9b5f7069f2b2a4c40086f314e75\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-4.ec2.internal"
Jul 22 20:56:42.691586 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:42.691559    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found"
Jul 22 20:56:42.701901 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.701882    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9edba1956cde62e13c8b32ed8cb33678-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal\" (UID: \"9edba1956cde62e13c8b32ed8cb33678\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal"
Jul 22 20:56:42.701945 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.701907    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9edba1956cde62e13c8b32ed8cb33678-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal\" (UID: \"9edba1956cde62e13c8b32ed8cb33678\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal"
Jul 22 20:56:42.701945 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.701922    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee01c9b5f7069f2b2a4c40086f314e75-config\") pod \"kube-apiserver-proxy-ip-10-0-133-4.ec2.internal\" (UID: \"ee01c9b5f7069f2b2a4c40086f314e75\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-4.ec2.internal"
Jul 22 20:56:42.702003 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.701954    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee01c9b5f7069f2b2a4c40086f314e75-config\") pod \"kube-apiserver-proxy-ip-10-0-133-4.ec2.internal\" (UID: \"ee01c9b5f7069f2b2a4c40086f314e75\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-4.ec2.internal"
Jul 22 20:56:42.702003 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.701970    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9edba1956cde62e13c8b32ed8cb33678-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal\" (UID: \"9edba1956cde62e13c8b32ed8cb33678\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal"
Jul 22 20:56:42.702003 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.701977    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9edba1956cde62e13c8b32ed8cb33678-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal\" (UID: \"9edba1956cde62e13c8b32ed8cb33678\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal"
Jul 22 20:56:42.792261 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:42.792224    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found"
Jul 22 20:56:42.838756 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.838739    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal"
Jul 22 20:56:42.844997 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:42.844975    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-4.ec2.internal"
Jul 22 20:56:42.892343 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:42.892320    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found"
Jul 22 20:56:42.992816 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:42.992783    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found"
Jul 22 20:56:43.093295 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:43.093244    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found"
Jul 22 20:56:43.193832 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:43.193804    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found"
Jul 22 20:56:43.242323 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:43.242299    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 20:56:43.242758 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:43.242442    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 20:56:43.294261 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:43.294237    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found"
Jul 22 20:56:43.336357 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:43.336327    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 20:51:42 +0000 UTC" deadline="2028-01-19 17:56:36.729669566 +0000 UTC"
Jul 22 20:56:43.336357 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:43.336351    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13100h59m53.393322192s"
Jul 22 20:56:43.394665 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:43.394607    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found"
Jul 22 20:56:43.418741 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:43.418720    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 20:56:43.419535 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:43.419520    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 20:56:43.419617 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:43.419550    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 20:56:43.419617 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:43.419559    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientPID"
Jul 22 20:56:43.495230 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:43.495210    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found"
Jul 22 20:56:43.564818 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:43.564787    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9edba1956cde62e13c8b32ed8cb33678.slice/crio-c99e0a816f9b997568beadca9e5c2d976d4f9d42169df7aec00965472de72ae8 WatchSource:0}: Error finding container c99e0a816f9b997568beadca9e5c2d976d4f9d42169df7aec00965472de72ae8: Status 404 returned error can't find the container with id c99e0a816f9b997568beadca9e5c2d976d4f9d42169df7aec00965472de72ae8
Jul 22 20:56:43.568501 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:43.568485    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 20:56:43.595898 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:43.595869    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found"
Jul 22 20:56:43.623170 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:43.621799    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 20:56:43.696585 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:43.696564    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found"
Jul 22 20:56:43.796746 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:43.796716    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found"
Jul 22 20:56:43.816783 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:43.816755    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee01c9b5f7069f2b2a4c40086f314e75.slice/crio-08c1fdbb3e5d18a21b7e578c0853987004e61d2add073bc6a31d78f15e958541 WatchSource:0}: Error finding container 08c1fdbb3e5d18a21b7e578c0853987004e61d2add073bc6a31d78f15e958541: Status 404 returned error can't find the container with id 08c1fdbb3e5d18a21b7e578c0853987004e61d2add073bc6a31d78f15e958541
Jul 22 20:56:43.841583 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:43.841559    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 20:56:43.857864 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:43.857846    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 20:56:43.899806 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:43.899775    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal"
Jul 22 20:56:43.913308 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:43.913262    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 20:56:43.914305 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:43.914293    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-4.ec2.internal"
Jul 22 20:56:43.923027 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:43.923014    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 20:56:44.223947 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.223889    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 20:56:44.283270 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.283245    2583 apiserver.go:52] "Watching apiserver"
Jul 22 20:56:44.290059 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.290026    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 20:56:44.290480 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.290451    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-tw8rc","openshift-multus/multus-xmq4c","openshift-multus/network-metrics-daemon-f6h54","openshift-network-diagnostics/network-check-target-snfgw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl","openshift-cluster-node-tuning-operator/tuned-6vqxg","openshift-dns/node-resolver-dfp6m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal","openshift-network-operator/iptables-alerter-8xb2q","openshift-ovn-kubernetes/ovnkube-node-d9gf8","kube-system/global-pull-secret-syncer-84495","kube-system/konnectivity-agent-mhtkv","kube-system/kube-apiserver-proxy-ip-10-0-133-4.ec2.internal","openshift-image-registry/node-ca-c297s"]
Jul 22 20:56:44.293582 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.293554    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.296468 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.296441    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.296943 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.296859    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 20:56:44.296943 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.296909    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 20:56:44.297120 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.297093    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 20:56:44.297202 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.297191    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 20:56:44.297276 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.297205    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hfv76\""
Jul 22 20:56:44.297330 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.297313    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 20:56:44.297439 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.297416    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 20:56:44.298895 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.298875    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:56:44.299006 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:44.298979    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6h54" podUID="e32f596b-8ead-471c-8e23-92b5816c3cd9"
Jul 22 20:56:44.299269 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.299107    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 20:56:44.299269 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.299123    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 20:56:44.299269 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.299112    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 20:56:44.299537 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.299516    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 20:56:44.299756 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.299625    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 20:56:44.299756 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.299693    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 20:56:44.300037 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.300016    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xknr8\""
Jul 22 20:56:44.301504 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.301475    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mhtkv"
Jul 22 20:56:44.303998 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.303974    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl"
Jul 22 20:56:44.304120 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.304099    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6vtmr\""
Jul 22 20:56:44.304235 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.304129    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 20:56:44.304235 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.304195    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 20:56:44.306537 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.306492    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.307269 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.307234    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 20:56:44.307868 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.307749    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 20:56:44.307868 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.307843    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 20:56:44.309267 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.307950    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kxl4c\""
Jul 22 20:56:44.309692 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.309495    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 20:56:44.309692 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.309626    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 20:56:44.309881 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.309854    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2qvv8\""
Jul 22 20:56:44.310417 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.310390    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 20:56:44.311096 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.311063    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-host-run-netns\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.311277 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.311201    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b1bf362-79df-4816-848b-b825bde19b3e-cni-binary-copy\") pod \"multus-additional-cni-plugins-tw8rc\" (UID: \"1b1bf362-79df-4816-848b-b825bde19b3e\") " pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.311277 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.311217    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8xb2q"
Jul 22 20:56:44.311277 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.311255    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-host-cni-bin\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.311527 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.311297    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d8ee72b3-bea8-4a9a-8254-8bf3ed035489-konnectivity-ca\") pod \"konnectivity-agent-mhtkv\" (UID: \"d8ee72b3-bea8-4a9a-8254-8bf3ed035489\") " pod="kube-system/konnectivity-agent-mhtkv"
Jul 22 20:56:44.311527 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.311333    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-systemd-units\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.311527 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.311365    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c3a8cc08-56da-4430-b228-b082eb897e8e-env-overrides\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.311527 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.311405    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwzvh\" (UniqueName: \"kubernetes.io/projected/c3a8cc08-56da-4430-b228-b082eb897e8e-kube-api-access-zwzvh\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.311527 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.311446    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1b1bf362-79df-4816-848b-b825bde19b3e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tw8rc\" (UID: \"1b1bf362-79df-4816-848b-b825bde19b3e\") " pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.311527 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.311486    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs\") pod \"network-metrics-daemon-f6h54\" (UID: \"e32f596b-8ead-471c-8e23-92b5816c3cd9\") " pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:56:44.311527 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.311527    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-host-kubelet\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.311956 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.311562    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-node-log\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.311956 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.311601    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-log-socket\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.311956 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.311641    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d8ee72b3-bea8-4a9a-8254-8bf3ed035489-agent-certs\") pod \"konnectivity-agent-mhtkv\" (UID: \"d8ee72b3-bea8-4a9a-8254-8bf3ed035489\") " pod="kube-system/konnectivity-agent-mhtkv"
Jul 22 20:56:44.311956 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.311682    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-host-slash\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.311956 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.311850    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c3a8cc08-56da-4430-b228-b082eb897e8e-ovnkube-config\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.311956 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.311919    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b1bf362-79df-4816-848b-b825bde19b3e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tw8rc\" (UID: \"1b1bf362-79df-4816-848b-b825bde19b3e\") " pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.312334 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.312197    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1b1bf362-79df-4816-848b-b825bde19b3e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tw8rc\" (UID: \"1b1bf362-79df-4816-848b-b825bde19b3e\") " pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.312334 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.312238    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-run-systemd\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.312334 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.312276    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-run-ovn\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.312509 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.312325    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mj8l\" (UniqueName: \"kubernetes.io/projected/e32f596b-8ead-471c-8e23-92b5816c3cd9-kube-api-access-7mj8l\") pod \"network-metrics-daemon-f6h54\" (UID: \"e32f596b-8ead-471c-8e23-92b5816c3cd9\") " pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:56:44.312906 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.312870    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b1bf362-79df-4816-848b-b825bde19b3e-cnibin\") pod \"multus-additional-cni-plugins-tw8rc\" (UID: \"1b1bf362-79df-4816-848b-b825bde19b3e\") " pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.312979 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.312943    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1b1bf362-79df-4816-848b-b825bde19b3e-os-release\") pod \"multus-additional-cni-plugins-tw8rc\" (UID: \"1b1bf362-79df-4816-848b-b825bde19b3e\") " pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.313070 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.312985    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-etc-openvswitch\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.313070 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.313017    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3a8cc08-56da-4430-b228-b082eb897e8e-ovn-node-metrics-cert\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.313070 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.313045    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c3a8cc08-56da-4430-b228-b082eb897e8e-ovnkube-script-lib\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.313281 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.313073    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b1bf362-79df-4816-848b-b825bde19b3e-system-cni-dir\") pod \"multus-additional-cni-plugins-tw8rc\" (UID: \"1b1bf362-79df-4816-848b-b825bde19b3e\") " pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.313281 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.313106    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-var-lib-openvswitch\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.313281 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.313149    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-run-openvswitch\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.313281 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.313193    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-host-run-ovn-kubernetes\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.313281 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.313238    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-host-cni-netd\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.313281 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.313263    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.313673 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.313288    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfmsl\" (UniqueName: \"kubernetes.io/projected/1b1bf362-79df-4816-848b-b825bde19b3e-kube-api-access-zfmsl\") pod \"multus-additional-cni-plugins-tw8rc\" (UID: \"1b1bf362-79df-4816-848b-b825bde19b3e\") " pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.313673 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.313320    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s2kst\""
Jul 22 20:56:44.313673 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.313634    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 20:56:44.313845 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.313675    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 20:56:44.313845 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.313712    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 20:56:44.315207 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.315183    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dfp6m"
Jul 22 20:56:44.317671 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.317646    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 20:56:44.317786 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.317681    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 20:56:44.317786 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.317762    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-67w5g\""
Jul 22 20:56:44.318032 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.317923    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:56:44.318032 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:44.318002    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84495" podUID="091e389d-9d92-429c-a165-cf119fbfa842"
Jul 22 20:56:44.320526 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.320500    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.322677 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.322655    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 20:56:44.322790 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.322711    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-97jx2\""
Jul 22 20:56:44.323220 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.323200    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:56:44.323307 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:44.323258    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snfgw" podUID="39625b20-2f3e-4c8c-975a-2896fd53f18a"
Jul 22 20:56:44.325948 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.325921    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c297s"
Jul 22 20:56:44.328758 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.328730    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 20:56:44.329189 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.329166    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 20:56:44.329309 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.329264    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 20:56:44.329378 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.329360    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wfqsg\""
Jul 22 20:56:44.339150 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.339124    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-w6m66"
Jul 22 20:56:44.350270 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.350249    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-w6m66"
Jul 22 20:56:44.400761 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.400740    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 20:56:44.407510 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.407471    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal" event={"ID":"9edba1956cde62e13c8b32ed8cb33678","Type":"ContainerStarted","Data":"c99e0a816f9b997568beadca9e5c2d976d4f9d42169df7aec00965472de72ae8"}
Jul 22 20:56:44.408561 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.408545    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-4.ec2.internal" event={"ID":"ee01c9b5f7069f2b2a4c40086f314e75","Type":"ContainerStarted","Data":"08c1fdbb3e5d18a21b7e578c0853987004e61d2add073bc6a31d78f15e958541"}
Jul 22 20:56:44.414975 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.414951    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cbd2f4ea-4b94-43f6-a43c-4abf65913d07-socket-dir\") pod \"aws-ebs-csi-driver-node-d4zpl\" (UID: \"cbd2f4ea-4b94-43f6-a43c-4abf65913d07\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl"
Jul 22 20:56:44.415054 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.414990    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1805063a-02a0-4bc1-bf4a-99138f1d3057-iptables-alerter-script\") pod \"iptables-alerter-8xb2q\" (UID: \"1805063a-02a0-4bc1-bf4a-99138f1d3057\") " pod="openshift-network-operator/iptables-alerter-8xb2q"
Jul 22 20:56:44.415054 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415021    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-cnibin\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.415054 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415049    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/80f40282-865b-4237-9192-0343b966ab60-multus-daemon-config\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.415225 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415074    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-etc-modprobe-d\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.415225 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415104    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-host\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.415225 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415138    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b14274a-0241-464a-876e-a6ec2f7c8d9e-host\") pod \"node-ca-c297s\" (UID: \"9b14274a-0241-464a-876e-a6ec2f7c8d9e\") " pod="openshift-image-registry/node-ca-c297s"
Jul 22 20:56:44.415225 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415160    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-etc-openvswitch\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.415225 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415176    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3a8cc08-56da-4430-b228-b082eb897e8e-ovn-node-metrics-cert\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.415225 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415202    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b1bf362-79df-4816-848b-b825bde19b3e-system-cni-dir\") pod \"multus-additional-cni-plugins-tw8rc\" (UID: \"1b1bf362-79df-4816-848b-b825bde19b3e\") " pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.415225 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415217    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1a1f1a0e-55dc-437e-8c3b-71761636dae8-etc-tuned\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.415517 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415231    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c52e7ef-2939-4ccc-9b94-ad30fe6e6a15-tmp-dir\") pod \"node-resolver-dfp6m\" (UID: \"3c52e7ef-2939-4ccc-9b94-ad30fe6e6a15\") " pod="openshift-dns/node-resolver-dfp6m"
Jul 22 20:56:44.415517 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415250    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxjnw\" (UniqueName: \"kubernetes.io/projected/3c52e7ef-2939-4ccc-9b94-ad30fe6e6a15-kube-api-access-qxjnw\") pod \"node-resolver-dfp6m\" (UID: \"3c52e7ef-2939-4ccc-9b94-ad30fe6e6a15\") " pod="openshift-dns/node-resolver-dfp6m"
Jul 22 20:56:44.415517 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415227    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-etc-openvswitch\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.415517 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415268    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b1bf362-79df-4816-848b-b825bde19b3e-system-cni-dir\") pod \"multus-additional-cni-plugins-tw8rc\" (UID: \"1b1bf362-79df-4816-848b-b825bde19b3e\") " pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.415517 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415307    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b14274a-0241-464a-876e-a6ec2f7c8d9e-serviceca\") pod \"node-ca-c297s\" (UID: \"9b14274a-0241-464a-876e-a6ec2f7c8d9e\") " pod="openshift-image-registry/node-ca-c297s"
Jul 22 20:56:44.415517 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415340    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-run-openvswitch\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.415517 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415365    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-host-run-ovn-kubernetes\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.415517 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415412    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-run-openvswitch\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.415517 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415424    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.415517 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415465    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-host-run-ovn-kubernetes\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.415517 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415472    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.415517 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415465    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-etc-sysctl-d\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.416040 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415550    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwrsc\" (UniqueName: \"kubernetes.io/projected/1a1f1a0e-55dc-437e-8c3b-71761636dae8-kube-api-access-kwrsc\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.416040 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415578    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/091e389d-9d92-429c-a165-cf119fbfa842-kubelet-config\") pod \"global-pull-secret-syncer-84495\" (UID: \"091e389d-9d92-429c-a165-cf119fbfa842\") " pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:56:44.416040 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415604    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-host-var-lib-cni-bin\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.416040 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415612    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 20:56:44.416040 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415630    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-host-run-multus-certs\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.416040 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415682    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-host-run-netns\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.416040 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415717    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091e389d-9d92-429c-a165-cf119fbfa842-original-pull-secret\") pod \"global-pull-secret-syncer-84495\" (UID: \"091e389d-9d92-429c-a165-cf119fbfa842\") " pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:56:44.416040 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415736    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-host-run-netns\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.416040 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415739    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cbd2f4ea-4b94-43f6-a43c-4abf65913d07-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d4zpl\" (UID: \"cbd2f4ea-4b94-43f6-a43c-4abf65913d07\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl"
Jul 22 20:56:44.416040 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415804    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-host-cni-bin\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.416040 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415834    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d8ee72b3-bea8-4a9a-8254-8bf3ed035489-konnectivity-ca\") pod \"konnectivity-agent-mhtkv\" (UID: \"d8ee72b3-bea8-4a9a-8254-8bf3ed035489\") " pod="kube-system/konnectivity-agent-mhtkv"
Jul 22 20:56:44.416040 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415846    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-host-cni-bin\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.416040 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415859    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-systemd-units\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.416040 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415884    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwzvh\" (UniqueName: \"kubernetes.io/projected/c3a8cc08-56da-4430-b228-b082eb897e8e-kube-api-access-zwzvh\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.416040 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415907    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs\") pod \"network-metrics-daemon-f6h54\" (UID: \"e32f596b-8ead-471c-8e23-92b5816c3cd9\") " pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:56:44.416040 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415931    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-systemd-units\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.416040 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:44.416036    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:56:44.416825 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:44.416124    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs podName:e32f596b-8ead-471c-8e23-92b5816c3cd9 nodeName:}" failed. No retries permitted until 2026-07-22 20:56:44.916101691 +0000 UTC m=+2.940140270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs") pod "network-metrics-daemon-f6h54" (UID: "e32f596b-8ead-471c-8e23-92b5816c3cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:56:44.416825 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.415934    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-etc-sysconfig\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.416825 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416269    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a1f1a0e-55dc-437e-8c3b-71761636dae8-tmp\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.416825 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416299    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c52e7ef-2939-4ccc-9b94-ad30fe6e6a15-hosts-file\") pod \"node-resolver-dfp6m\" (UID: \"3c52e7ef-2939-4ccc-9b94-ad30fe6e6a15\") " pod="openshift-dns/node-resolver-dfp6m"
Jul 22 20:56:44.416825 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416331    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-node-log\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.416825 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416357    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-var-lib-kubelet\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.416825 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416383    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-hostroot\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.416825 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416410    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-etc-kubernetes\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.416825 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416430    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-node-log\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.416825 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416435    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c3a8cc08-56da-4430-b228-b082eb897e8e-ovnkube-config\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.416825 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416460    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/091e389d-9d92-429c-a165-cf119fbfa842-dbus\") pod \"global-pull-secret-syncer-84495\" (UID: \"091e389d-9d92-429c-a165-cf119fbfa842\") " pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:56:44.416825 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-run-systemd\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.416825 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416524    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d8ee72b3-bea8-4a9a-8254-8bf3ed035489-konnectivity-ca\") pod \"konnectivity-agent-mhtkv\" (UID: \"d8ee72b3-bea8-4a9a-8254-8bf3ed035489\") " pod="kube-system/konnectivity-agent-mhtkv"
Jul 22 20:56:44.416825 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416580    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-run-ovn\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.416825 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416659    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-run-systemd\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.416825 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416696    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mj8l\" (UniqueName: \"kubernetes.io/projected/e32f596b-8ead-471c-8e23-92b5816c3cd9-kube-api-access-7mj8l\") pod \"network-metrics-daemon-f6h54\" (UID: \"e32f596b-8ead-471c-8e23-92b5816c3cd9\") " pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:56:44.416825 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416718    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-run-ovn\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.417702 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416728    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxhsx\" (UniqueName: \"kubernetes.io/projected/39625b20-2f3e-4c8c-975a-2896fd53f18a-kube-api-access-zxhsx\") pod \"network-check-target-snfgw\" (UID: \"39625b20-2f3e-4c8c-975a-2896fd53f18a\") " pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:56:44.417702 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416762    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cbd2f4ea-4b94-43f6-a43c-4abf65913d07-sys-fs\") pod \"aws-ebs-csi-driver-node-d4zpl\" (UID: \"cbd2f4ea-4b94-43f6-a43c-4abf65913d07\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl"
Jul 22 20:56:44.417702 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416788    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg7th\" (UniqueName: \"kubernetes.io/projected/1805063a-02a0-4bc1-bf4a-99138f1d3057-kube-api-access-xg7th\") pod \"iptables-alerter-8xb2q\" (UID: \"1805063a-02a0-4bc1-bf4a-99138f1d3057\") " pod="openshift-network-operator/iptables-alerter-8xb2q"
Jul 22 20:56:44.417702 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416824    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-multus-socket-dir-parent\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.417702 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416845    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b1bf362-79df-4816-848b-b825bde19b3e-cnibin\") pod \"multus-additional-cni-plugins-tw8rc\" (UID: \"1b1bf362-79df-4816-848b-b825bde19b3e\") " pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.417702 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416889    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b1bf362-79df-4816-848b-b825bde19b3e-cnibin\") pod \"multus-additional-cni-plugins-tw8rc\" (UID: \"1b1bf362-79df-4816-848b-b825bde19b3e\") " pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.417702 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416923    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1b1bf362-79df-4816-848b-b825bde19b3e-os-release\") pod \"multus-additional-cni-plugins-tw8rc\" (UID: \"1b1bf362-79df-4816-848b-b825bde19b3e\") " pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.417702 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416951    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c3a8cc08-56da-4430-b228-b082eb897e8e-ovnkube-script-lib\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.417702 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416958    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c3a8cc08-56da-4430-b228-b082eb897e8e-ovnkube-config\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.417702 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416978    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cbd2f4ea-4b94-43f6-a43c-4abf65913d07-etc-selinux\") pod \"aws-ebs-csi-driver-node-d4zpl\" (UID: \"cbd2f4ea-4b94-43f6-a43c-4abf65913d07\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl"
Jul 22 20:56:44.417702 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.416994    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1b1bf362-79df-4816-848b-b825bde19b3e-os-release\") pod \"multus-additional-cni-plugins-tw8rc\" (UID: \"1b1bf362-79df-4816-848b-b825bde19b3e\") " pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.417702 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417004    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-system-cni-dir\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.417702 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417033    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80f40282-865b-4237-9192-0343b966ab60-cni-binary-copy\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.417702 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417057    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-host-var-lib-cni-multus\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.417702 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417083    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-multus-conf-dir\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.417702 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417108    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-var-lib-openvswitch\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.417702 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417157    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-host-cni-netd\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.418535 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417185    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfmsl\" (UniqueName: \"kubernetes.io/projected/1b1bf362-79df-4816-848b-b825bde19b3e-kube-api-access-zfmsl\") pod \"multus-additional-cni-plugins-tw8rc\" (UID: \"1b1bf362-79df-4816-848b-b825bde19b3e\") " pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.418535 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417213    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-etc-sysctl-conf\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.418535 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417206    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-var-lib-openvswitch\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.418535 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417238    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-etc-systemd\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.418535 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417263    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-multus-cni-dir\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.418535 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417290    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-host-cni-netd\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.418535 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417297    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b1bf362-79df-4816-848b-b825bde19b3e-cni-binary-copy\") pod \"multus-additional-cni-plugins-tw8rc\" (UID: \"1b1bf362-79df-4816-848b-b825bde19b3e\") " pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.418535 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417323    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v76zx\" (UniqueName: \"kubernetes.io/projected/cbd2f4ea-4b94-43f6-a43c-4abf65913d07-kube-api-access-v76zx\") pod \"aws-ebs-csi-driver-node-d4zpl\" (UID: \"cbd2f4ea-4b94-43f6-a43c-4abf65913d07\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl"
Jul 22 20:56:44.418535 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417349    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1805063a-02a0-4bc1-bf4a-99138f1d3057-host-slash\") pod \"iptables-alerter-8xb2q\" (UID: \"1805063a-02a0-4bc1-bf4a-99138f1d3057\") " pod="openshift-network-operator/iptables-alerter-8xb2q"
Jul 22 20:56:44.418535 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417376    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c3a8cc08-56da-4430-b228-b082eb897e8e-ovnkube-script-lib\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.418535 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417378    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-host-run-k8s-cni-cncf-io\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.418535 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417419    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-host-run-netns\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.418535 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417471    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-etc-kubernetes\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.418535 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417486    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-lib-modules\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.418535 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417501    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-os-release\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.418535 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417532    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c3a8cc08-56da-4430-b228-b082eb897e8e-env-overrides\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.418535 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417569    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1b1bf362-79df-4816-848b-b825bde19b3e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tw8rc\" (UID: \"1b1bf362-79df-4816-848b-b825bde19b3e\") " pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.419052 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417896    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c3a8cc08-56da-4430-b228-b082eb897e8e-env-overrides\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.419052 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417924    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-sys\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.419052 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417947    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvq2d\" (UniqueName: \"kubernetes.io/projected/80f40282-865b-4237-9192-0343b966ab60-kube-api-access-dvq2d\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.419052 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417955    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b1bf362-79df-4816-848b-b825bde19b3e-cni-binary-copy\") pod \"multus-additional-cni-plugins-tw8rc\" (UID: \"1b1bf362-79df-4816-848b-b825bde19b3e\") " pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.419052 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.417985    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-host-kubelet\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.419052 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.418001    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-log-socket\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.419052 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.418016    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d8ee72b3-bea8-4a9a-8254-8bf3ed035489-agent-certs\") pod \"konnectivity-agent-mhtkv\" (UID: \"d8ee72b3-bea8-4a9a-8254-8bf3ed035489\") " pod="kube-system/konnectivity-agent-mhtkv"
Jul 22 20:56:44.419052 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.418032    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cbd2f4ea-4b94-43f6-a43c-4abf65913d07-registration-dir\") pod \"aws-ebs-csi-driver-node-d4zpl\" (UID: \"cbd2f4ea-4b94-43f6-a43c-4abf65913d07\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl"
Jul 22 20:56:44.419052 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.418057    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cbd2f4ea-4b94-43f6-a43c-4abf65913d07-device-dir\") pod \"aws-ebs-csi-driver-node-d4zpl\" (UID: \"cbd2f4ea-4b94-43f6-a43c-4abf65913d07\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl"
Jul 22 20:56:44.419052 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.418073    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-host-var-lib-kubelet\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.419052 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.418070    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1b1bf362-79df-4816-848b-b825bde19b3e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tw8rc\" (UID: \"1b1bf362-79df-4816-848b-b825bde19b3e\") " pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.419052 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.418090    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-log-socket\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.419052 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.418104    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtm5k\" (UniqueName: \"kubernetes.io/projected/9b14274a-0241-464a-876e-a6ec2f7c8d9e-kube-api-access-mtm5k\") pod \"node-ca-c297s\" (UID: \"9b14274a-0241-464a-876e-a6ec2f7c8d9e\") " pod="openshift-image-registry/node-ca-c297s"
Jul 22 20:56:44.419052 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.418121    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-host-kubelet\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.419052 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.418133    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-host-slash\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.419052 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.418157    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b1bf362-79df-4816-848b-b825bde19b3e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tw8rc\" (UID: \"1b1bf362-79df-4816-848b-b825bde19b3e\") " pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.419052 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.418176    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3a8cc08-56da-4430-b228-b082eb897e8e-host-slash\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.419631 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.418184    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1b1bf362-79df-4816-848b-b825bde19b3e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tw8rc\" (UID: \"1b1bf362-79df-4816-848b-b825bde19b3e\") " pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.419631 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.418227    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-run\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.419631 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.418283    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b1bf362-79df-4816-848b-b825bde19b3e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tw8rc\" (UID: \"1b1bf362-79df-4816-848b-b825bde19b3e\") " pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.419631 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.418749    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1b1bf362-79df-4816-848b-b825bde19b3e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tw8rc\" (UID: \"1b1bf362-79df-4816-848b-b825bde19b3e\") " pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.419631 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.419583    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3a8cc08-56da-4430-b228-b082eb897e8e-ovn-node-metrics-cert\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.420617 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.420600    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d8ee72b3-bea8-4a9a-8254-8bf3ed035489-agent-certs\") pod \"konnectivity-agent-mhtkv\" (UID: \"d8ee72b3-bea8-4a9a-8254-8bf3ed035489\") " pod="kube-system/konnectivity-agent-mhtkv"
Jul 22 20:56:44.424832 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.424797    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mj8l\" (UniqueName: \"kubernetes.io/projected/e32f596b-8ead-471c-8e23-92b5816c3cd9-kube-api-access-7mj8l\") pod \"network-metrics-daemon-f6h54\" (UID: \"e32f596b-8ead-471c-8e23-92b5816c3cd9\") " pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:56:44.424832 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.424824    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwzvh\" (UniqueName: \"kubernetes.io/projected/c3a8cc08-56da-4430-b228-b082eb897e8e-kube-api-access-zwzvh\") pod \"ovnkube-node-d9gf8\" (UID: \"c3a8cc08-56da-4430-b228-b082eb897e8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.425437 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.425419    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfmsl\" (UniqueName: \"kubernetes.io/projected/1b1bf362-79df-4816-848b-b825bde19b3e-kube-api-access-zfmsl\") pod \"multus-additional-cni-plugins-tw8rc\" (UID: \"1b1bf362-79df-4816-848b-b825bde19b3e\") " pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.519454 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519400    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/091e389d-9d92-429c-a165-cf119fbfa842-kubelet-config\") pod \"global-pull-secret-syncer-84495\" (UID: \"091e389d-9d92-429c-a165-cf119fbfa842\") " pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:56:44.519454 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519429    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-host-var-lib-cni-bin\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.519454 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519444    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-host-run-multus-certs\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.519612 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519464    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091e389d-9d92-429c-a165-cf119fbfa842-original-pull-secret\") pod \"global-pull-secret-syncer-84495\" (UID: \"091e389d-9d92-429c-a165-cf119fbfa842\") " pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:56:44.519612 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519490    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cbd2f4ea-4b94-43f6-a43c-4abf65913d07-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d4zpl\" (UID: \"cbd2f4ea-4b94-43f6-a43c-4abf65913d07\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl"
Jul 22 20:56:44.519612 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519511    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-host-var-lib-cni-bin\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.519612 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519533    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-host-run-multus-certs\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.519612 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519546    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cbd2f4ea-4b94-43f6-a43c-4abf65913d07-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d4zpl\" (UID: \"cbd2f4ea-4b94-43f6-a43c-4abf65913d07\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl"
Jul 22 20:56:44.519612 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519570    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/091e389d-9d92-429c-a165-cf119fbfa842-kubelet-config\") pod \"global-pull-secret-syncer-84495\" (UID: \"091e389d-9d92-429c-a165-cf119fbfa842\") " pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:56:44.519612 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:44.519588    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 20:56:44.519877 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519620    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-etc-sysconfig\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.519877 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:44.519633    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091e389d-9d92-429c-a165-cf119fbfa842-original-pull-secret podName:091e389d-9d92-429c-a165-cf119fbfa842 nodeName:}" failed. No retries permitted until 2026-07-22 20:56:45.019621487 +0000 UTC m=+3.043660045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/091e389d-9d92-429c-a165-cf119fbfa842-original-pull-secret") pod "global-pull-secret-syncer-84495" (UID: "091e389d-9d92-429c-a165-cf119fbfa842") : object "kube-system"/"original-pull-secret" not registered
Jul 22 20:56:44.519877 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519664    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a1f1a0e-55dc-437e-8c3b-71761636dae8-tmp\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.519877 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519667    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-etc-sysconfig\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.519877 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519693    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c52e7ef-2939-4ccc-9b94-ad30fe6e6a15-hosts-file\") pod \"node-resolver-dfp6m\" (UID: \"3c52e7ef-2939-4ccc-9b94-ad30fe6e6a15\") " pod="openshift-dns/node-resolver-dfp6m"
Jul 22 20:56:44.519877 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519720    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-var-lib-kubelet\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.519877 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519744    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-hostroot\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.519877 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519752    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c52e7ef-2939-4ccc-9b94-ad30fe6e6a15-hosts-file\") pod \"node-resolver-dfp6m\" (UID: \"3c52e7ef-2939-4ccc-9b94-ad30fe6e6a15\") " pod="openshift-dns/node-resolver-dfp6m"
Jul 22 20:56:44.519877 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519767    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-etc-kubernetes\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.519877 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519776    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-var-lib-kubelet\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.519877 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519781    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-hostroot\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.519877 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519792    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/091e389d-9d92-429c-a165-cf119fbfa842-dbus\") pod \"global-pull-secret-syncer-84495\" (UID: \"091e389d-9d92-429c-a165-cf119fbfa842\") " pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:56:44.519877 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519808    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-etc-kubernetes\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.519877 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519820    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxhsx\" (UniqueName: \"kubernetes.io/projected/39625b20-2f3e-4c8c-975a-2896fd53f18a-kube-api-access-zxhsx\") pod \"network-check-target-snfgw\" (UID: \"39625b20-2f3e-4c8c-975a-2896fd53f18a\") " pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:56:44.519877 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519844    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cbd2f4ea-4b94-43f6-a43c-4abf65913d07-sys-fs\") pod \"aws-ebs-csi-driver-node-d4zpl\" (UID: \"cbd2f4ea-4b94-43f6-a43c-4abf65913d07\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl"
Jul 22 20:56:44.520477 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519893    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cbd2f4ea-4b94-43f6-a43c-4abf65913d07-sys-fs\") pod \"aws-ebs-csi-driver-node-d4zpl\" (UID: \"cbd2f4ea-4b94-43f6-a43c-4abf65913d07\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl"
Jul 22 20:56:44.520477 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519919    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg7th\" (UniqueName: \"kubernetes.io/projected/1805063a-02a0-4bc1-bf4a-99138f1d3057-kube-api-access-xg7th\") pod \"iptables-alerter-8xb2q\" (UID: \"1805063a-02a0-4bc1-bf4a-99138f1d3057\") " pod="openshift-network-operator/iptables-alerter-8xb2q"
Jul 22 20:56:44.520477 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519929    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/091e389d-9d92-429c-a165-cf119fbfa842-dbus\") pod \"global-pull-secret-syncer-84495\" (UID: \"091e389d-9d92-429c-a165-cf119fbfa842\") " pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:56:44.520477 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519935    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-multus-socket-dir-parent\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.520477 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519971    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cbd2f4ea-4b94-43f6-a43c-4abf65913d07-etc-selinux\") pod \"aws-ebs-csi-driver-node-d4zpl\" (UID: \"cbd2f4ea-4b94-43f6-a43c-4abf65913d07\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl"
Jul 22 20:56:44.520477 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.519997    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-system-cni-dir\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.520477 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520007    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-multus-socket-dir-parent\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.520477 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520012    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80f40282-865b-4237-9192-0343b966ab60-cni-binary-copy\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.520477 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520065    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-host-var-lib-cni-multus\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.520477 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520090    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-multus-conf-dir\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.520477 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520098    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-system-cni-dir\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.520477 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520104    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cbd2f4ea-4b94-43f6-a43c-4abf65913d07-etc-selinux\") pod \"aws-ebs-csi-driver-node-d4zpl\" (UID: \"cbd2f4ea-4b94-43f6-a43c-4abf65913d07\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl"
Jul 22 20:56:44.520477 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520163    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-multus-conf-dir\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.520477 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520167    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-host-var-lib-cni-multus\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.520477 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520188    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-etc-sysctl-conf\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.520477 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520269    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-etc-sysctl-conf\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.520477 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520361    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-etc-systemd\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.520477 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520376    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-etc-systemd\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.521313 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520401    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-multus-cni-dir\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.521313 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520431    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v76zx\" (UniqueName: \"kubernetes.io/projected/cbd2f4ea-4b94-43f6-a43c-4abf65913d07-kube-api-access-v76zx\") pod \"aws-ebs-csi-driver-node-d4zpl\" (UID: \"cbd2f4ea-4b94-43f6-a43c-4abf65913d07\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl"
Jul 22 20:56:44.521313 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520460    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1805063a-02a0-4bc1-bf4a-99138f1d3057-host-slash\") pod \"iptables-alerter-8xb2q\" (UID: \"1805063a-02a0-4bc1-bf4a-99138f1d3057\") " pod="openshift-network-operator/iptables-alerter-8xb2q"
Jul 22 20:56:44.521313 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520466    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-multus-cni-dir\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.521313 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520487    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-host-run-k8s-cni-cncf-io\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.521313 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520503    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1805063a-02a0-4bc1-bf4a-99138f1d3057-host-slash\") pod \"iptables-alerter-8xb2q\" (UID: \"1805063a-02a0-4bc1-bf4a-99138f1d3057\") " pod="openshift-network-operator/iptables-alerter-8xb2q"
Jul 22 20:56:44.521313 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520513    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-host-run-netns\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.521313 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520531    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-host-run-k8s-cni-cncf-io\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.521313 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520533    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80f40282-865b-4237-9192-0343b966ab60-cni-binary-copy\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.521313 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520540    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-etc-kubernetes\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.521313 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520566    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-lib-modules\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.521313 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520582    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-host-run-netns\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.521313 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520594    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-os-release\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.521313 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520621    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-sys\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.521313 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520617    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-etc-kubernetes\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.521313 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520647    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvq2d\" (UniqueName: \"kubernetes.io/projected/80f40282-865b-4237-9192-0343b966ab60-kube-api-access-dvq2d\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.521313 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520663    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-lib-modules\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.521313 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520682    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-os-release\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.522066 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520688    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cbd2f4ea-4b94-43f6-a43c-4abf65913d07-registration-dir\") pod \"aws-ebs-csi-driver-node-d4zpl\" (UID: \"cbd2f4ea-4b94-43f6-a43c-4abf65913d07\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl"
Jul 22 20:56:44.522066 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520684    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-sys\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.522066 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520726    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cbd2f4ea-4b94-43f6-a43c-4abf65913d07-device-dir\") pod \"aws-ebs-csi-driver-node-d4zpl\" (UID: \"cbd2f4ea-4b94-43f6-a43c-4abf65913d07\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl"
Jul 22 20:56:44.522066 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520753    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cbd2f4ea-4b94-43f6-a43c-4abf65913d07-registration-dir\") pod \"aws-ebs-csi-driver-node-d4zpl\" (UID: \"cbd2f4ea-4b94-43f6-a43c-4abf65913d07\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl"
Jul 22 20:56:44.522066 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520755    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-host-var-lib-kubelet\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.522066 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520766    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cbd2f4ea-4b94-43f6-a43c-4abf65913d07-device-dir\") pod \"aws-ebs-csi-driver-node-d4zpl\" (UID: \"cbd2f4ea-4b94-43f6-a43c-4abf65913d07\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl"
Jul 22 20:56:44.522066 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520786    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtm5k\" (UniqueName: \"kubernetes.io/projected/9b14274a-0241-464a-876e-a6ec2f7c8d9e-kube-api-access-mtm5k\") pod \"node-ca-c297s\" (UID: \"9b14274a-0241-464a-876e-a6ec2f7c8d9e\") " pod="openshift-image-registry/node-ca-c297s"
Jul 22 20:56:44.522066 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520788    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-host-var-lib-kubelet\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.522066 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520900    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-run\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.522066 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520930    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cbd2f4ea-4b94-43f6-a43c-4abf65913d07-socket-dir\") pod \"aws-ebs-csi-driver-node-d4zpl\" (UID: \"cbd2f4ea-4b94-43f6-a43c-4abf65913d07\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl"
Jul 22 20:56:44.522066 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520947    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1805063a-02a0-4bc1-bf4a-99138f1d3057-iptables-alerter-script\") pod \"iptables-alerter-8xb2q\" (UID: \"1805063a-02a0-4bc1-bf4a-99138f1d3057\") " pod="openshift-network-operator/iptables-alerter-8xb2q"
Jul 22 20:56:44.522066 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520962    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-cnibin\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.522066 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.520978    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/80f40282-865b-4237-9192-0343b966ab60-multus-daemon-config\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.522066 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.521021    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-run\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.522066 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.521030    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80f40282-865b-4237-9192-0343b966ab60-cnibin\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.522066 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.521081    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cbd2f4ea-4b94-43f6-a43c-4abf65913d07-socket-dir\") pod \"aws-ebs-csi-driver-node-d4zpl\" (UID: \"cbd2f4ea-4b94-43f6-a43c-4abf65913d07\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl"
Jul 22 20:56:44.522066 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.521213    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-etc-modprobe-d\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.522066 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.521401    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/80f40282-865b-4237-9192-0343b966ab60-multus-daemon-config\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.522646 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.521003    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-etc-modprobe-d\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.522646 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.521450    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1805063a-02a0-4bc1-bf4a-99138f1d3057-iptables-alerter-script\") pod \"iptables-alerter-8xb2q\" (UID: \"1805063a-02a0-4bc1-bf4a-99138f1d3057\") " pod="openshift-network-operator/iptables-alerter-8xb2q"
Jul 22 20:56:44.522646 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.521454    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-host\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.522646 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.521492    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-host\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.522646 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.521495    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b14274a-0241-464a-876e-a6ec2f7c8d9e-host\") pod \"node-ca-c297s\" (UID: \"9b14274a-0241-464a-876e-a6ec2f7c8d9e\") " pod="openshift-image-registry/node-ca-c297s"
Jul 22 20:56:44.522646 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.521523    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1a1f1a0e-55dc-437e-8c3b-71761636dae8-etc-tuned\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.522646 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.521543    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b14274a-0241-464a-876e-a6ec2f7c8d9e-host\") pod \"node-ca-c297s\" (UID: \"9b14274a-0241-464a-876e-a6ec2f7c8d9e\") " pod="openshift-image-registry/node-ca-c297s"
Jul 22 20:56:44.522646 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.521549    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c52e7ef-2939-4ccc-9b94-ad30fe6e6a15-tmp-dir\") pod \"node-resolver-dfp6m\" (UID: \"3c52e7ef-2939-4ccc-9b94-ad30fe6e6a15\") " pod="openshift-dns/node-resolver-dfp6m"
Jul 22 20:56:44.522646 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.521571    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxjnw\" (UniqueName: \"kubernetes.io/projected/3c52e7ef-2939-4ccc-9b94-ad30fe6e6a15-kube-api-access-qxjnw\") pod \"node-resolver-dfp6m\" (UID: \"3c52e7ef-2939-4ccc-9b94-ad30fe6e6a15\") " pod="openshift-dns/node-resolver-dfp6m"
Jul 22 20:56:44.522646 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.521588    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b14274a-0241-464a-876e-a6ec2f7c8d9e-serviceca\") pod \"node-ca-c297s\" (UID: \"9b14274a-0241-464a-876e-a6ec2f7c8d9e\") " pod="openshift-image-registry/node-ca-c297s"
Jul 22 20:56:44.522646 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.521609    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-etc-sysctl-d\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.522646 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.521634    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwrsc\" (UniqueName: \"kubernetes.io/projected/1a1f1a0e-55dc-437e-8c3b-71761636dae8-kube-api-access-kwrsc\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.522646 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.521772    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1a1f1a0e-55dc-437e-8c3b-71761636dae8-etc-sysctl-d\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.522646 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.521825    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c52e7ef-2939-4ccc-9b94-ad30fe6e6a15-tmp-dir\") pod \"node-resolver-dfp6m\" (UID: \"3c52e7ef-2939-4ccc-9b94-ad30fe6e6a15\") " pod="openshift-dns/node-resolver-dfp6m"
Jul 22 20:56:44.522646 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.522003    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a1f1a0e-55dc-437e-8c3b-71761636dae8-tmp\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.522646 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.522178    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b14274a-0241-464a-876e-a6ec2f7c8d9e-serviceca\") pod \"node-ca-c297s\" (UID: \"9b14274a-0241-464a-876e-a6ec2f7c8d9e\") " pod="openshift-image-registry/node-ca-c297s"
Jul 22 20:56:44.523478 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.523459    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1a1f1a0e-55dc-437e-8c3b-71761636dae8-etc-tuned\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.527259 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:44.527241    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 20:56:44.527350 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:44.527266    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 20:56:44.527350 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:44.527279    2583 projected.go:196] Error preparing data for projected volume kube-api-access-zxhsx for pod openshift-network-diagnostics/network-check-target-snfgw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:56:44.527350 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:44.527333    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39625b20-2f3e-4c8c-975a-2896fd53f18a-kube-api-access-zxhsx podName:39625b20-2f3e-4c8c-975a-2896fd53f18a nodeName:}" failed. No retries permitted until 2026-07-22 20:56:45.027316104 +0000 UTC m=+3.051354665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zxhsx" (UniqueName: "kubernetes.io/projected/39625b20-2f3e-4c8c-975a-2896fd53f18a-kube-api-access-zxhsx") pod "network-check-target-snfgw" (UID: "39625b20-2f3e-4c8c-975a-2896fd53f18a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:56:44.529382 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.529356    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v76zx\" (UniqueName: \"kubernetes.io/projected/cbd2f4ea-4b94-43f6-a43c-4abf65913d07-kube-api-access-v76zx\") pod \"aws-ebs-csi-driver-node-d4zpl\" (UID: \"cbd2f4ea-4b94-43f6-a43c-4abf65913d07\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl"
Jul 22 20:56:44.529667 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.529644    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg7th\" (UniqueName: \"kubernetes.io/projected/1805063a-02a0-4bc1-bf4a-99138f1d3057-kube-api-access-xg7th\") pod \"iptables-alerter-8xb2q\" (UID: \"1805063a-02a0-4bc1-bf4a-99138f1d3057\") " pod="openshift-network-operator/iptables-alerter-8xb2q"
Jul 22 20:56:44.529817 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.529798    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvq2d\" (UniqueName: \"kubernetes.io/projected/80f40282-865b-4237-9192-0343b966ab60-kube-api-access-dvq2d\") pod \"multus-xmq4c\" (UID: \"80f40282-865b-4237-9192-0343b966ab60\") " pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.530124 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.530106    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxjnw\" (UniqueName: \"kubernetes.io/projected/3c52e7ef-2939-4ccc-9b94-ad30fe6e6a15-kube-api-access-qxjnw\") pod \"node-resolver-dfp6m\" (UID: \"3c52e7ef-2939-4ccc-9b94-ad30fe6e6a15\") " pod="openshift-dns/node-resolver-dfp6m"
Jul 22 20:56:44.530574 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.530551    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwrsc\" (UniqueName: \"kubernetes.io/projected/1a1f1a0e-55dc-437e-8c3b-71761636dae8-kube-api-access-kwrsc\") pod \"tuned-6vqxg\" (UID: \"1a1f1a0e-55dc-437e-8c3b-71761636dae8\") " pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.530679 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.530658    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtm5k\" (UniqueName: \"kubernetes.io/projected/9b14274a-0241-464a-876e-a6ec2f7c8d9e-kube-api-access-mtm5k\") pod \"node-ca-c297s\" (UID: \"9b14274a-0241-464a-876e-a6ec2f7c8d9e\") " pod="openshift-image-registry/node-ca-c297s"
Jul 22 20:56:44.606149 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.606111    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:56:44.614649 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.614620    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tw8rc"
Jul 22 20:56:44.617903 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:44.617880    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a8cc08_56da_4430_b228_b082eb897e8e.slice/crio-dbdf09cc9ea74d7463b0cc8c67684136070e810082074bc4e6d6514422ed4e3c WatchSource:0}: Error finding container dbdf09cc9ea74d7463b0cc8c67684136070e810082074bc4e6d6514422ed4e3c: Status 404 returned error can't find the container with id dbdf09cc9ea74d7463b0cc8c67684136070e810082074bc4e6d6514422ed4e3c
Jul 22 20:56:44.623086 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.622715    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mhtkv"
Jul 22 20:56:44.626635 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:44.626612    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b1bf362_79df_4816_848b_b825bde19b3e.slice/crio-aa4dd3c9bff81164cda68efc77bc2587943dd4b9c137df15e4b9642fd2f66ff6 WatchSource:0}: Error finding container aa4dd3c9bff81164cda68efc77bc2587943dd4b9c137df15e4b9642fd2f66ff6: Status 404 returned error can't find the container with id aa4dd3c9bff81164cda68efc77bc2587943dd4b9c137df15e4b9642fd2f66ff6
Jul 22 20:56:44.628669 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.628650    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl"
Jul 22 20:56:44.632811 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:44.632360    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8ee72b3_bea8_4a9a_8254_8bf3ed035489.slice/crio-0eedf481b4af8cd5d447685a7e3a132665ba1bef26dacc1d23bf70c7ddc04ba9 WatchSource:0}: Error finding container 0eedf481b4af8cd5d447685a7e3a132665ba1bef26dacc1d23bf70c7ddc04ba9: Status 404 returned error can't find the container with id 0eedf481b4af8cd5d447685a7e3a132665ba1bef26dacc1d23bf70c7ddc04ba9
Jul 22 20:56:44.636265 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.636246    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6vqxg"
Jul 22 20:56:44.640970 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:44.640945    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbd2f4ea_4b94_43f6_a43c_4abf65913d07.slice/crio-aa8decf32246ba7cd9975be36669168e5af6a2f73e88d4c73df73d0a12c66416 WatchSource:0}: Error finding container aa8decf32246ba7cd9975be36669168e5af6a2f73e88d4c73df73d0a12c66416: Status 404 returned error can't find the container with id aa8decf32246ba7cd9975be36669168e5af6a2f73e88d4c73df73d0a12c66416
Jul 22 20:56:44.643303 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.643280    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8xb2q"
Jul 22 20:56:44.646341 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:44.646230    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a1f1a0e_55dc_437e_8c3b_71761636dae8.slice/crio-8bb6bdb3471b0280168a0f3c785b1ca247a26e73a53d363f70997a0482d1669c WatchSource:0}: Error finding container 8bb6bdb3471b0280168a0f3c785b1ca247a26e73a53d363f70997a0482d1669c: Status 404 returned error can't find the container with id 8bb6bdb3471b0280168a0f3c785b1ca247a26e73a53d363f70997a0482d1669c
Jul 22 20:56:44.650771 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.650751    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dfp6m"
Jul 22 20:56:44.652921 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:44.652886    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1805063a_02a0_4bc1_bf4a_99138f1d3057.slice/crio-1150ffa459792f97ce5a3aafa296101a098a4dd2fa2a956a2c508cce3fb11af9 WatchSource:0}: Error finding container 1150ffa459792f97ce5a3aafa296101a098a4dd2fa2a956a2c508cce3fb11af9: Status 404 returned error can't find the container with id 1150ffa459792f97ce5a3aafa296101a098a4dd2fa2a956a2c508cce3fb11af9
Jul 22 20:56:44.658541 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.658277    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xmq4c"
Jul 22 20:56:44.661916 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:44.661893    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c52e7ef_2939_4ccc_9b94_ad30fe6e6a15.slice/crio-59da36cc55349041490a48b1db00c391f6cfb2c2ba527bfa8ca09ff4bcb150b1 WatchSource:0}: Error finding container 59da36cc55349041490a48b1db00c391f6cfb2c2ba527bfa8ca09ff4bcb150b1: Status 404 returned error can't find the container with id 59da36cc55349041490a48b1db00c391f6cfb2c2ba527bfa8ca09ff4bcb150b1
Jul 22 20:56:44.663357 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.663339    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c297s"
Jul 22 20:56:44.668662 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:44.668629    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f40282_865b_4237_9192_0343b966ab60.slice/crio-77eaa138517f6d03170aa2475955979b9f386cfe1698f619a4d6d5eaeea84e4d WatchSource:0}: Error finding container 77eaa138517f6d03170aa2475955979b9f386cfe1698f619a4d6d5eaeea84e4d: Status 404 returned error can't find the container with id 77eaa138517f6d03170aa2475955979b9f386cfe1698f619a4d6d5eaeea84e4d
Jul 22 20:56:44.674064 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:56:44.674034    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b14274a_0241_464a_876e_a6ec2f7c8d9e.slice/crio-986c45c3c6beba52e0812abb6d1ae77465945ca2567fc73b08237016af943e08 WatchSource:0}: Error finding container 986c45c3c6beba52e0812abb6d1ae77465945ca2567fc73b08237016af943e08: Status 404 returned error can't find the container with id 986c45c3c6beba52e0812abb6d1ae77465945ca2567fc73b08237016af943e08
Jul 22 20:56:44.927575 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:44.927484    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs\") pod \"network-metrics-daemon-f6h54\" (UID: \"e32f596b-8ead-471c-8e23-92b5816c3cd9\") " pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:56:44.927738 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:44.927650    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:56:44.927738 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:44.927717    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs podName:e32f596b-8ead-471c-8e23-92b5816c3cd9 nodeName:}" failed. No retries permitted until 2026-07-22 20:56:45.927697041 +0000 UTC m=+3.951735604 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs") pod "network-metrics-daemon-f6h54" (UID: "e32f596b-8ead-471c-8e23-92b5816c3cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:56:45.028457 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:45.028414    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091e389d-9d92-429c-a165-cf119fbfa842-original-pull-secret\") pod \"global-pull-secret-syncer-84495\" (UID: \"091e389d-9d92-429c-a165-cf119fbfa842\") " pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:56:45.028693 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:45.028491    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxhsx\" (UniqueName: \"kubernetes.io/projected/39625b20-2f3e-4c8c-975a-2896fd53f18a-kube-api-access-zxhsx\") pod \"network-check-target-snfgw\" (UID: \"39625b20-2f3e-4c8c-975a-2896fd53f18a\") " pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:56:45.028693 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:45.028625    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 20:56:45.028693 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:45.028641    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 20:56:45.028693 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:45.028654    2583 projected.go:196] Error preparing data for projected volume kube-api-access-zxhsx for pod openshift-network-diagnostics/network-check-target-snfgw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:56:45.028904 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:45.028708    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39625b20-2f3e-4c8c-975a-2896fd53f18a-kube-api-access-zxhsx podName:39625b20-2f3e-4c8c-975a-2896fd53f18a nodeName:}" failed. No retries permitted until 2026-07-22 20:56:46.028694423 +0000 UTC m=+4.052732981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxhsx" (UniqueName: "kubernetes.io/projected/39625b20-2f3e-4c8c-975a-2896fd53f18a-kube-api-access-zxhsx") pod "network-check-target-snfgw" (UID: "39625b20-2f3e-4c8c-975a-2896fd53f18a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:56:45.028904 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:45.028716    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 20:56:45.028904 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:45.028769    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091e389d-9d92-429c-a165-cf119fbfa842-original-pull-secret podName:091e389d-9d92-429c-a165-cf119fbfa842 nodeName:}" failed. No retries permitted until 2026-07-22 20:56:46.028754469 +0000 UTC m=+4.052793027 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/091e389d-9d92-429c-a165-cf119fbfa842-original-pull-secret") pod "global-pull-secret-syncer-84495" (UID: "091e389d-9d92-429c-a165-cf119fbfa842") : object "kube-system"/"original-pull-secret" not registered
Jul 22 20:56:45.353913 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:45.353801    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 20:51:44 +0000 UTC" deadline="2028-02-26 11:43:08.039512567 +0000 UTC"
Jul 22 20:56:45.353913 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:45.353871    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14006h46m22.685659228s"
Jul 22 20:56:45.404439 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:45.404404    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:56:45.404578 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:45.404537    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snfgw" podUID="39625b20-2f3e-4c8c-975a-2896fd53f18a"
Jul 22 20:56:45.418292 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:45.418260    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xmq4c" event={"ID":"80f40282-865b-4237-9192-0343b966ab60","Type":"ContainerStarted","Data":"77eaa138517f6d03170aa2475955979b9f386cfe1698f619a4d6d5eaeea84e4d"}
Jul 22 20:56:45.419592 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:45.419566    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dfp6m" event={"ID":"3c52e7ef-2939-4ccc-9b94-ad30fe6e6a15","Type":"ContainerStarted","Data":"59da36cc55349041490a48b1db00c391f6cfb2c2ba527bfa8ca09ff4bcb150b1"}
Jul 22 20:56:45.421039 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:45.420998    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8xb2q" event={"ID":"1805063a-02a0-4bc1-bf4a-99138f1d3057","Type":"ContainerStarted","Data":"1150ffa459792f97ce5a3aafa296101a098a4dd2fa2a956a2c508cce3fb11af9"}
Jul 22 20:56:45.422472 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:45.422410    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl" event={"ID":"cbd2f4ea-4b94-43f6-a43c-4abf65913d07","Type":"ContainerStarted","Data":"aa8decf32246ba7cd9975be36669168e5af6a2f73e88d4c73df73d0a12c66416"}
Jul 22 20:56:45.424192 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:45.424163    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8" event={"ID":"c3a8cc08-56da-4430-b228-b082eb897e8e","Type":"ContainerStarted","Data":"dbdf09cc9ea74d7463b0cc8c67684136070e810082074bc4e6d6514422ed4e3c"}
Jul 22 20:56:45.425807 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:45.425781    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6vqxg" event={"ID":"1a1f1a0e-55dc-437e-8c3b-71761636dae8","Type":"ContainerStarted","Data":"8bb6bdb3471b0280168a0f3c785b1ca247a26e73a53d363f70997a0482d1669c"}
Jul 22 20:56:45.427464 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:45.427429    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mhtkv" event={"ID":"d8ee72b3-bea8-4a9a-8254-8bf3ed035489","Type":"ContainerStarted","Data":"0eedf481b4af8cd5d447685a7e3a132665ba1bef26dacc1d23bf70c7ddc04ba9"}
Jul 22 20:56:45.428992 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:45.428962    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw8rc" event={"ID":"1b1bf362-79df-4816-848b-b825bde19b3e","Type":"ContainerStarted","Data":"aa4dd3c9bff81164cda68efc77bc2587943dd4b9c137df15e4b9642fd2f66ff6"}
Jul 22 20:56:45.430387 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:45.430361    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c297s" event={"ID":"9b14274a-0241-464a-876e-a6ec2f7c8d9e","Type":"ContainerStarted","Data":"986c45c3c6beba52e0812abb6d1ae77465945ca2567fc73b08237016af943e08"}
Jul 22 20:56:45.936185 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:45.935563    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs\") pod \"network-metrics-daemon-f6h54\" (UID: \"e32f596b-8ead-471c-8e23-92b5816c3cd9\") " pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:56:45.936185 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:45.935752    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:56:45.936185 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:45.935812    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs podName:e32f596b-8ead-471c-8e23-92b5816c3cd9 nodeName:}" failed. No retries permitted until 2026-07-22 20:56:47.935793149 +0000 UTC m=+5.959831712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs") pod "network-metrics-daemon-f6h54" (UID: "e32f596b-8ead-471c-8e23-92b5816c3cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:56:46.036436 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:46.036344    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091e389d-9d92-429c-a165-cf119fbfa842-original-pull-secret\") pod \"global-pull-secret-syncer-84495\" (UID: \"091e389d-9d92-429c-a165-cf119fbfa842\") " pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:56:46.036436 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:46.036414    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxhsx\" (UniqueName: \"kubernetes.io/projected/39625b20-2f3e-4c8c-975a-2896fd53f18a-kube-api-access-zxhsx\") pod \"network-check-target-snfgw\" (UID: \"39625b20-2f3e-4c8c-975a-2896fd53f18a\") " pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:56:46.036640 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:46.036582    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 20:56:46.036640 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:46.036599    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 20:56:46.036640 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:46.036608    2583 projected.go:196] Error preparing data for projected volume kube-api-access-zxhsx for pod openshift-network-diagnostics/network-check-target-snfgw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:56:46.036949 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:46.036665    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39625b20-2f3e-4c8c-975a-2896fd53f18a-kube-api-access-zxhsx podName:39625b20-2f3e-4c8c-975a-2896fd53f18a nodeName:}" failed. No retries permitted until 2026-07-22 20:56:48.036646449 +0000 UTC m=+6.060685035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxhsx" (UniqueName: "kubernetes.io/projected/39625b20-2f3e-4c8c-975a-2896fd53f18a-kube-api-access-zxhsx") pod "network-check-target-snfgw" (UID: "39625b20-2f3e-4c8c-975a-2896fd53f18a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:56:46.037096 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:46.037079    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 20:56:46.037199 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:46.037125    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091e389d-9d92-429c-a165-cf119fbfa842-original-pull-secret podName:091e389d-9d92-429c-a165-cf119fbfa842 nodeName:}" failed. No retries permitted until 2026-07-22 20:56:48.037113504 +0000 UTC m=+6.061152062 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/091e389d-9d92-429c-a165-cf119fbfa842-original-pull-secret") pod "global-pull-secret-syncer-84495" (UID: "091e389d-9d92-429c-a165-cf119fbfa842") : object "kube-system"/"original-pull-secret" not registered
Jul 22 20:56:46.354628 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:46.354526    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 20:51:44 +0000 UTC" deadline="2028-04-21 18:30:53.359533172 +0000 UTC"
Jul 22 20:56:46.354628 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:46.354574    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15333h34m7.004963834s"
Jul 22 20:56:46.405244 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:46.404491    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:56:46.405244 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:46.404622    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84495" podUID="091e389d-9d92-429c-a165-cf119fbfa842"
Jul 22 20:56:46.405244 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:46.405073    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:56:46.405244 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:46.405200    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6h54" podUID="e32f596b-8ead-471c-8e23-92b5816c3cd9"
Jul 22 20:56:47.403867 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:47.403790    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:56:47.404330 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:47.403919    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snfgw" podUID="39625b20-2f3e-4c8c-975a-2896fd53f18a"
Jul 22 20:56:47.954338 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:47.953783    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs\") pod \"network-metrics-daemon-f6h54\" (UID: \"e32f596b-8ead-471c-8e23-92b5816c3cd9\") " pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:56:47.954338 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:47.953935    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:56:47.954338 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:47.953992    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs podName:e32f596b-8ead-471c-8e23-92b5816c3cd9 nodeName:}" failed. No retries permitted until 2026-07-22 20:56:51.953974352 +0000 UTC m=+9.978012913 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs") pod "network-metrics-daemon-f6h54" (UID: "e32f596b-8ead-471c-8e23-92b5816c3cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:56:48.055635 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:48.054891    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091e389d-9d92-429c-a165-cf119fbfa842-original-pull-secret\") pod \"global-pull-secret-syncer-84495\" (UID: \"091e389d-9d92-429c-a165-cf119fbfa842\") " pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:56:48.055635 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:48.054950    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxhsx\" (UniqueName: \"kubernetes.io/projected/39625b20-2f3e-4c8c-975a-2896fd53f18a-kube-api-access-zxhsx\") pod \"network-check-target-snfgw\" (UID: \"39625b20-2f3e-4c8c-975a-2896fd53f18a\") " pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:56:48.055635 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:48.055081    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 20:56:48.055635 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:48.055102    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 20:56:48.055635 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:48.055143    2583 projected.go:196] Error preparing data for projected volume kube-api-access-zxhsx for pod openshift-network-diagnostics/network-check-target-snfgw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:56:48.055635 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:48.055195    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39625b20-2f3e-4c8c-975a-2896fd53f18a-kube-api-access-zxhsx podName:39625b20-2f3e-4c8c-975a-2896fd53f18a nodeName:}" failed. No retries permitted until 2026-07-22 20:56:52.055177197 +0000 UTC m=+10.079215761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxhsx" (UniqueName: "kubernetes.io/projected/39625b20-2f3e-4c8c-975a-2896fd53f18a-kube-api-access-zxhsx") pod "network-check-target-snfgw" (UID: "39625b20-2f3e-4c8c-975a-2896fd53f18a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:56:48.055635 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:48.055554    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 20:56:48.055635 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:48.055600    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091e389d-9d92-429c-a165-cf119fbfa842-original-pull-secret podName:091e389d-9d92-429c-a165-cf119fbfa842 nodeName:}" failed. No retries permitted until 2026-07-22 20:56:52.055586687 +0000 UTC m=+10.079625250 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/091e389d-9d92-429c-a165-cf119fbfa842-original-pull-secret") pod "global-pull-secret-syncer-84495" (UID: "091e389d-9d92-429c-a165-cf119fbfa842") : object "kube-system"/"original-pull-secret" not registered
Jul 22 20:56:48.405300 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:48.405224    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:56:48.405726 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:48.405372    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6h54" podUID="e32f596b-8ead-471c-8e23-92b5816c3cd9"
Jul 22 20:56:48.405787 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:48.405740    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:56:48.405865 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:48.405841    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84495" podUID="091e389d-9d92-429c-a165-cf119fbfa842"
Jul 22 20:56:49.404182 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:49.404147    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:56:49.404370 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:49.404275    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snfgw" podUID="39625b20-2f3e-4c8c-975a-2896fd53f18a"
Jul 22 20:56:50.404655 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:50.404617    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:56:50.405024 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:50.404748    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84495" podUID="091e389d-9d92-429c-a165-cf119fbfa842"
Jul 22 20:56:50.407616 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:50.407447    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:56:50.407616 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:50.407569    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6h54" podUID="e32f596b-8ead-471c-8e23-92b5816c3cd9"
Jul 22 20:56:51.404213 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:51.404177    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:56:51.404382 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:51.404308    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snfgw" podUID="39625b20-2f3e-4c8c-975a-2896fd53f18a"
Jul 22 20:56:51.986394 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:51.986362    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs\") pod \"network-metrics-daemon-f6h54\" (UID: \"e32f596b-8ead-471c-8e23-92b5816c3cd9\") " pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:56:51.986816 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:51.986546    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:56:51.986816 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:51.986622    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs podName:e32f596b-8ead-471c-8e23-92b5816c3cd9 nodeName:}" failed. No retries permitted until 2026-07-22 20:56:59.986601229 +0000 UTC m=+18.010639792 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs") pod "network-metrics-daemon-f6h54" (UID: "e32f596b-8ead-471c-8e23-92b5816c3cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:56:52.087376 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:52.087343    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxhsx\" (UniqueName: \"kubernetes.io/projected/39625b20-2f3e-4c8c-975a-2896fd53f18a-kube-api-access-zxhsx\") pod \"network-check-target-snfgw\" (UID: \"39625b20-2f3e-4c8c-975a-2896fd53f18a\") " pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:56:52.087527 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:52.087441    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091e389d-9d92-429c-a165-cf119fbfa842-original-pull-secret\") pod \"global-pull-secret-syncer-84495\" (UID: \"091e389d-9d92-429c-a165-cf119fbfa842\") " pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:56:52.087589 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:52.087522    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 20:56:52.087589 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:52.087542    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 20:56:52.087589 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:52.087541    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 20:56:52.087589 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:52.087552    2583 projected.go:196] Error preparing data for projected volume kube-api-access-zxhsx for pod openshift-network-diagnostics/network-check-target-snfgw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:56:52.087754 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:52.087606    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091e389d-9d92-429c-a165-cf119fbfa842-original-pull-secret podName:091e389d-9d92-429c-a165-cf119fbfa842 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:00.087587392 +0000 UTC m=+18.111625949 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/091e389d-9d92-429c-a165-cf119fbfa842-original-pull-secret") pod "global-pull-secret-syncer-84495" (UID: "091e389d-9d92-429c-a165-cf119fbfa842") : object "kube-system"/"original-pull-secret" not registered
Jul 22 20:56:52.087754 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:52.087624    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39625b20-2f3e-4c8c-975a-2896fd53f18a-kube-api-access-zxhsx podName:39625b20-2f3e-4c8c-975a-2896fd53f18a nodeName:}" failed. No retries permitted until 2026-07-22 20:57:00.087616108 +0000 UTC m=+18.111654667 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxhsx" (UniqueName: "kubernetes.io/projected/39625b20-2f3e-4c8c-975a-2896fd53f18a-kube-api-access-zxhsx") pod "network-check-target-snfgw" (UID: "39625b20-2f3e-4c8c-975a-2896fd53f18a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:56:52.406433 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:52.406167    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:56:52.406562 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:52.406477    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84495" podUID="091e389d-9d92-429c-a165-cf119fbfa842"
Jul 22 20:56:52.406562 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:52.406530    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:56:52.406627 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:52.406607    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6h54" podUID="e32f596b-8ead-471c-8e23-92b5816c3cd9"
Jul 22 20:56:53.403718 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:53.403680    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:56:53.404335 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:53.403790    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snfgw" podUID="39625b20-2f3e-4c8c-975a-2896fd53f18a"
Jul 22 20:56:54.405158 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:54.404558    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:56:54.405158 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:54.404740    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84495" podUID="091e389d-9d92-429c-a165-cf119fbfa842"
Jul 22 20:56:54.405158 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:54.405044    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:56:54.405883 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:54.405815    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6h54" podUID="e32f596b-8ead-471c-8e23-92b5816c3cd9"
Jul 22 20:56:55.404202 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:55.404126    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:56:55.404340 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:55.404248    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snfgw" podUID="39625b20-2f3e-4c8c-975a-2896fd53f18a"
Jul 22 20:56:56.403958 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:56.403930    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:56:56.404430 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:56.403940    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:56:56.404430 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:56.404027    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84495" podUID="091e389d-9d92-429c-a165-cf119fbfa842"
Jul 22 20:56:56.404430 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:56.404170    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6h54" podUID="e32f596b-8ead-471c-8e23-92b5816c3cd9"
Jul 22 20:56:57.403885 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:57.403857    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:56:57.404056 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:57.403952    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snfgw" podUID="39625b20-2f3e-4c8c-975a-2896fd53f18a"
Jul 22 20:56:58.404687 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:58.404653    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:56:58.405164 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:58.404653    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:56:58.405164 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:58.404796    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84495" podUID="091e389d-9d92-429c-a165-cf119fbfa842"
Jul 22 20:56:58.405164 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:58.404877    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6h54" podUID="e32f596b-8ead-471c-8e23-92b5816c3cd9"
Jul 22 20:56:59.404560 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:56:59.404493    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:56:59.404715 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:56:59.404604    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snfgw" podUID="39625b20-2f3e-4c8c-975a-2896fd53f18a"
Jul 22 20:57:00.050891 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:00.050864    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs\") pod \"network-metrics-daemon-f6h54\" (UID: \"e32f596b-8ead-471c-8e23-92b5816c3cd9\") " pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:57:00.051046 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:00.051026    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:57:00.051130 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:00.051103    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs podName:e32f596b-8ead-471c-8e23-92b5816c3cd9 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:16.051087028 +0000 UTC m=+34.075125586 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs") pod "network-metrics-daemon-f6h54" (UID: "e32f596b-8ead-471c-8e23-92b5816c3cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:57:00.152000 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:00.151966    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091e389d-9d92-429c-a165-cf119fbfa842-original-pull-secret\") pod \"global-pull-secret-syncer-84495\" (UID: \"091e389d-9d92-429c-a165-cf119fbfa842\") " pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:57:00.152144 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:00.152021    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxhsx\" (UniqueName: \"kubernetes.io/projected/39625b20-2f3e-4c8c-975a-2896fd53f18a-kube-api-access-zxhsx\") pod \"network-check-target-snfgw\" (UID: \"39625b20-2f3e-4c8c-975a-2896fd53f18a\") " pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:57:00.152193 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:00.152175    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 20:57:00.152237 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:00.152197    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 20:57:00.152237 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:00.152211    2583 projected.go:196] Error preparing data for projected volume kube-api-access-zxhsx for pod openshift-network-diagnostics/network-check-target-snfgw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:57:00.152296 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:00.152261    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39625b20-2f3e-4c8c-975a-2896fd53f18a-kube-api-access-zxhsx podName:39625b20-2f3e-4c8c-975a-2896fd53f18a nodeName:}" failed. No retries permitted until 2026-07-22 20:57:16.152246968 +0000 UTC m=+34.176285526 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxhsx" (UniqueName: "kubernetes.io/projected/39625b20-2f3e-4c8c-975a-2896fd53f18a-kube-api-access-zxhsx") pod "network-check-target-snfgw" (UID: "39625b20-2f3e-4c8c-975a-2896fd53f18a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:57:00.152615 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:00.152591    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 20:57:00.152679 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:00.152639    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091e389d-9d92-429c-a165-cf119fbfa842-original-pull-secret podName:091e389d-9d92-429c-a165-cf119fbfa842 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:16.152626138 +0000 UTC m=+34.176664713 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/091e389d-9d92-429c-a165-cf119fbfa842-original-pull-secret") pod "global-pull-secret-syncer-84495" (UID: "091e389d-9d92-429c-a165-cf119fbfa842") : object "kube-system"/"original-pull-secret" not registered
Jul 22 20:57:00.406030 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:00.405956    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:57:00.406407 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:00.406076    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84495" podUID="091e389d-9d92-429c-a165-cf119fbfa842"
Jul 22 20:57:00.406407 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:00.406194    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:57:00.406407 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:00.406289    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6h54" podUID="e32f596b-8ead-471c-8e23-92b5816c3cd9"
Jul 22 20:57:01.404080 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:01.404047    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:57:01.404242 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:01.404186    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snfgw" podUID="39625b20-2f3e-4c8c-975a-2896fd53f18a"
Jul 22 20:57:02.404441 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:02.404408    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:57:02.404859 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:02.404522    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84495" podUID="091e389d-9d92-429c-a165-cf119fbfa842"
Jul 22 20:57:02.404859 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:02.404561    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:57:02.404859 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:02.404648    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6h54" podUID="e32f596b-8ead-471c-8e23-92b5816c3cd9"
Jul 22 20:57:03.403978 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:03.403945    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:57:03.404235 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:03.404071    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snfgw" podUID="39625b20-2f3e-4c8c-975a-2896fd53f18a"
Jul 22 20:57:04.406258 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:04.406229    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:57:04.406591 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:04.406362    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6h54" podUID="e32f596b-8ead-471c-8e23-92b5816c3cd9"
Jul 22 20:57:04.406836 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:04.406701    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:57:04.406836 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:04.406795    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84495" podUID="091e389d-9d92-429c-a165-cf119fbfa842"
Jul 22 20:57:04.473053 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:04.472797    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6vqxg" event={"ID":"1a1f1a0e-55dc-437e-8c3b-71761636dae8","Type":"ContainerStarted","Data":"4637cebbcf0bc13af3f89d6663e6d31176023192e89c0da398464922b60dfc5c"}
Jul 22 20:57:04.476164 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:04.475792    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-4.ec2.internal" event={"ID":"ee01c9b5f7069f2b2a4c40086f314e75","Type":"ContainerStarted","Data":"d352b46ded8e1e4bb0effc3b329a42e68462ab1db42527549222bdd7cfbc9c5a"}
Jul 22 20:57:04.478386 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:04.478362    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xmq4c" event={"ID":"80f40282-865b-4237-9192-0343b966ab60","Type":"ContainerStarted","Data":"a45acbb04eed4e88724038edec5b1505132e40b4dcfd884dba5c62b27922138b"}
Jul 22 20:57:04.480641 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:04.480588    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8" event={"ID":"c3a8cc08-56da-4430-b228-b082eb897e8e","Type":"ContainerStarted","Data":"409496395e76ba776f71ef14675e851813d273d71aef492b5195c4d1c51c502e"}
Jul 22 20:57:04.508206 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:04.507412    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6vqxg" podStartSLOduration=2.96486686 podStartE2EDuration="22.507393336s" totalImagesPullingTime="19.542526476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:56:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:04.489284892 +0000 UTC m=+22.513323472" watchObservedRunningTime="2026-07-22 20:57:04.507393336 +0000 UTC m=+22.531431915"
Jul 22 20:57:04.508206 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:04.508170    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xmq4c" podStartSLOduration=1.984466705 podStartE2EDuration="21.508158951s" totalImagesPullingTime="19.523692246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:56:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:04.506986097 +0000 UTC m=+22.531024677" watchObservedRunningTime="2026-07-22 20:57:04.508158951 +0000 UTC m=+22.532197532"
Jul 22 20:57:04.528640 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:04.528407    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-4.ec2.internal" podStartSLOduration=20.528386888 podStartE2EDuration="20.528386888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:56:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:04.528182088 +0000 UTC m=+22.552220668" watchObservedRunningTime="2026-07-22 20:57:04.528386888 +0000 UTC m=+22.552425469"
Jul 22 20:57:05.403644 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:05.403486    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:57:05.403811 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:05.403706    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snfgw" podUID="39625b20-2f3e-4c8c-975a-2896fd53f18a"
Jul 22 20:57:05.484271 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:05.484241    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c297s" event={"ID":"9b14274a-0241-464a-876e-a6ec2f7c8d9e","Type":"ContainerStarted","Data":"cba105096149574aad6298187ab319bed899cd8f9541e5feefd5eb35e66dae59"}
Jul 22 20:57:05.485785 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:05.485758    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dfp6m" event={"ID":"3c52e7ef-2939-4ccc-9b94-ad30fe6e6a15","Type":"ContainerStarted","Data":"abc982d3c631090e40f1e60f60c92774915cec32532febdabeaeae34297908cb"}
Jul 22 20:57:05.488773 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:05.488751    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl" event={"ID":"cbd2f4ea-4b94-43f6-a43c-4abf65913d07","Type":"ContainerStarted","Data":"d7072302895d0d1294dc7421031009c55d671b3bf71383588d1fabbdd8b23966"}
Jul 22 20:57:05.491844 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:05.491825    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8" event={"ID":"c3a8cc08-56da-4430-b228-b082eb897e8e","Type":"ContainerStarted","Data":"776a8c4b557e709accc545e3325a9d1fc118c40af845d518fc259f5ff82f0c16"}
Jul 22 20:57:05.491939 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:05.491897    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8" event={"ID":"c3a8cc08-56da-4430-b228-b082eb897e8e","Type":"ContainerStarted","Data":"47bc4248792ae2f2a632ea76b95d0a2fc0fd9b9bd2df5205c724be87d80e5072"}
Jul 22 20:57:05.492000 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:05.491949    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8" event={"ID":"c3a8cc08-56da-4430-b228-b082eb897e8e","Type":"ContainerStarted","Data":"4eaf35f713f971f726de309842662239fc4668fcc2f70cde90e9d5a356b0bd3e"}
Jul 22 20:57:05.492053 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:05.491999    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8" event={"ID":"c3a8cc08-56da-4430-b228-b082eb897e8e","Type":"ContainerStarted","Data":"113a016631fefaea4fd6f0d83074499a4713777c2629afb2f31556ff35fb9a89"}
Jul 22 20:57:05.492053 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:05.492048    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8" event={"ID":"c3a8cc08-56da-4430-b228-b082eb897e8e","Type":"ContainerStarted","Data":"3dca118222bee813d30e8f664b0378749940509f112bb8e61fe36e21b860ef37"}
Jul 22 20:57:05.493330 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:05.493302    2583 generic.go:356] "Generic (PLEG): container finished" podID="9edba1956cde62e13c8b32ed8cb33678" containerID="fe1b763cb40717159f3ecd5b7423b3b59ff21530350fa979df4953ebce362273" exitCode=0
Jul 22 20:57:05.493429 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:05.493391    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal" event={"ID":"9edba1956cde62e13c8b32ed8cb33678","Type":"ContainerDied","Data":"fe1b763cb40717159f3ecd5b7423b3b59ff21530350fa979df4953ebce362273"}
Jul 22 20:57:05.494840 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:05.494809    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mhtkv" event={"ID":"d8ee72b3-bea8-4a9a-8254-8bf3ed035489","Type":"ContainerStarted","Data":"a415ca83145d4c3b9fcdb9f72d5c22fa6f0840be2caacc804969860738b3b707"}
Jul 22 20:57:05.496287 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:05.496264    2583 generic.go:356] "Generic (PLEG): container finished" podID="1b1bf362-79df-4816-848b-b825bde19b3e" containerID="a05f6659eb1c8661467113606377a0cd038bd24ec41bd52fd8a7403916dbb973" exitCode=0
Jul 22 20:57:05.496374 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:05.496302    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw8rc" event={"ID":"1b1bf362-79df-4816-848b-b825bde19b3e","Type":"ContainerDied","Data":"a05f6659eb1c8661467113606377a0cd038bd24ec41bd52fd8a7403916dbb973"}
Jul 22 20:57:05.500489 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:05.499375    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-c297s" podStartSLOduration=2.982082026 podStartE2EDuration="22.499358183s" totalImagesPullingTime="19.517276157s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:56:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:05.498609529 +0000 UTC m=+23.522648085" watchObservedRunningTime="2026-07-22 20:57:05.499358183 +0000 UTC m=+23.523396773"
Jul 22 20:57:05.513495 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:05.513462    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dfp6m" podStartSLOduration=3.981537108 podStartE2EDuration="23.51345031s" totalImagesPullingTime="19.531913202s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:56:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:05.513293475 +0000 UTC m=+23.537332053" watchObservedRunningTime="2026-07-22 20:57:05.51345031 +0000 UTC m=+23.537488890"
Jul 22 20:57:05.543479 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:05.543447    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mhtkv" podStartSLOduration=8.20350274 podStartE2EDuration="23.543436707s" totalImagesPullingTime="15.339933967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:56:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:05.543103251 +0000 UTC m=+23.567141829" watchObservedRunningTime="2026-07-22 20:57:05.543436707 +0000 UTC m=+23.567475287"
Jul 22 20:57:05.960126 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:05.960090    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 20:57:06.369860 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:06.369756    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T20:57:05.960121114Z","UUID":"184cf564-1544-45f7-a397-831a9f78b2e3","Handler":null,"Name":"","Endpoint":""}
Jul 22 20:57:06.371075 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:06.371058    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 20:57:06.371186 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:06.371090    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 20:57:06.403884 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:06.403866    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:57:06.403982 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:06.403947    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84495" podUID="091e389d-9d92-429c-a165-cf119fbfa842"
Jul 22 20:57:06.404030 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:06.403993    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:57:06.404066 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:06.404050    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6h54" podUID="e32f596b-8ead-471c-8e23-92b5816c3cd9"
Jul 22 20:57:06.499188 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:06.499162    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8xb2q" event={"ID":"1805063a-02a0-4bc1-bf4a-99138f1d3057","Type":"ContainerStarted","Data":"44d1d4a0609e51b41ab5310e2f3a07082c08a472fe3ce10bd7044435edb22b89"}
Jul 22 20:57:06.501218 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:06.501196    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl" event={"ID":"cbd2f4ea-4b94-43f6-a43c-4abf65913d07","Type":"ContainerStarted","Data":"b69d0ecc3e1c0374a4df205aa55d119615ac34c5ac17d963bcf7a7afcfbbe6ed"}
Jul 22 20:57:06.503063 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:06.503037    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal" event={"ID":"9edba1956cde62e13c8b32ed8cb33678","Type":"ContainerStarted","Data":"7b11d400965faaeddcfd36bb3463040f62918cee302e2475c0f6d7e417f6a63a"}
Jul 22 20:57:06.525737 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:06.525696    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal" podStartSLOduration=22.52568153 podStartE2EDuration="22.52568153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:56:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:06.525621529 +0000 UTC m=+24.549660108" watchObservedRunningTime="2026-07-22 20:57:06.52568153 +0000 UTC m=+24.549720088"
Jul 22 20:57:06.525827 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:06.525761    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8xb2q" podStartSLOduration=4.992392078 podStartE2EDuration="24.525753974s" totalImagesPullingTime="19.533361896s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:56:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:06.512913095 +0000 UTC m=+24.536951671" watchObservedRunningTime="2026-07-22 20:57:06.525753974 +0000 UTC m=+24.549792552"
Jul 22 20:57:07.404030 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:07.404006    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:57:07.404159 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:07.404103    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snfgw" podUID="39625b20-2f3e-4c8c-975a-2896fd53f18a"
Jul 22 20:57:07.507451 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:07.507417    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl" event={"ID":"cbd2f4ea-4b94-43f6-a43c-4abf65913d07","Type":"ContainerStarted","Data":"51fee172f30540b0c4eac08fd8f4cf102e9378872e335338b941c3c6c173ac65"}
Jul 22 20:57:07.511347 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:07.511323    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8" event={"ID":"c3a8cc08-56da-4430-b228-b082eb897e8e","Type":"ContainerStarted","Data":"97da392a21796b6c0935e24a356ddb452b57ab5db05b263819569db48745bf27"}
Jul 22 20:57:07.525694 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:07.525632    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d4zpl" podStartSLOduration=7.477370131 podStartE2EDuration="25.52561583s" totalImagesPullingTime="18.048245699s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:56:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:07.525377632 +0000 UTC m=+25.549416216" watchObservedRunningTime="2026-07-22 20:57:07.52561583 +0000 UTC m=+25.549654410"
Jul 22 20:57:08.404639 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:08.404594    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:57:08.404821 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:08.404646    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:57:08.404821 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:08.404749    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6h54" podUID="e32f596b-8ead-471c-8e23-92b5816c3cd9"
Jul 22 20:57:08.404943 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:08.404877    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84495" podUID="091e389d-9d92-429c-a165-cf119fbfa842"
Jul 22 20:57:09.316898 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:09.316834    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mhtkv"
Jul 22 20:57:09.317402 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:09.317383    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mhtkv"
Jul 22 20:57:09.403790 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:09.403763    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:57:09.403919 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:09.403864    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snfgw" podUID="39625b20-2f3e-4c8c-975a-2896fd53f18a"
Jul 22 20:57:10.404555 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:10.404364    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:57:10.404957 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:10.404440    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:57:10.404957 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:10.404659    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84495" podUID="091e389d-9d92-429c-a165-cf119fbfa842"
Jul 22 20:57:10.404957 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:10.404741    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6h54" podUID="e32f596b-8ead-471c-8e23-92b5816c3cd9"
Jul 22 20:57:11.404558 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:11.404532    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:57:11.404683 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:11.404628    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snfgw" podUID="39625b20-2f3e-4c8c-975a-2896fd53f18a"
Jul 22 20:57:11.521671 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:11.521630    2583 generic.go:356] "Generic (PLEG): container finished" podID="1b1bf362-79df-4816-848b-b825bde19b3e" containerID="9c9785c2d29902761b5b15aaca8a1dddc54ff8113762cae6b1a55debfa3d92fb" exitCode=0
Jul 22 20:57:11.521797 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:11.521724    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw8rc" event={"ID":"1b1bf362-79df-4816-848b-b825bde19b3e","Type":"ContainerDied","Data":"9c9785c2d29902761b5b15aaca8a1dddc54ff8113762cae6b1a55debfa3d92fb"}
Jul 22 20:57:11.526492 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:11.526454    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8" event={"ID":"c3a8cc08-56da-4430-b228-b082eb897e8e","Type":"ContainerStarted","Data":"6fcb916b8ca06037aea6e5f6e3712c1ceacd9506556bfd0bcc1d8cc06ade0b5a"}
Jul 22 20:57:11.526808 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:11.526782    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:57:11.526906 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:11.526868    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:57:11.526960 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:11.526919    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:57:11.545062 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:11.545037    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:57:11.545196 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:11.545179    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:57:11.567768 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:11.567713    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8" podStartSLOduration=9.879715688 podStartE2EDuration="29.567701153s" totalImagesPullingTime="19.687985465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:56:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:11.566154929 +0000 UTC m=+29.590193507" watchObservedRunningTime="2026-07-22 20:57:11.567701153 +0000 UTC m=+29.591739732"
Jul 22 20:57:12.405153 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:12.404963    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:57:12.405452 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:12.405018    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:57:12.405452 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:12.405231    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84495" podUID="091e389d-9d92-429c-a165-cf119fbfa842"
Jul 22 20:57:12.405452 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:12.405292    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6h54" podUID="e32f596b-8ead-471c-8e23-92b5816c3cd9"
Jul 22 20:57:12.530847 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:12.530820    2583 generic.go:356] "Generic (PLEG): container finished" podID="1b1bf362-79df-4816-848b-b825bde19b3e" containerID="0eb3e58042707277922b7c25a5fa12c4fd8d21d5fa366eb734ff1e8970f9f568" exitCode=0
Jul 22 20:57:12.530944 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:12.530903    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw8rc" event={"ID":"1b1bf362-79df-4816-848b-b825bde19b3e","Type":"ContainerDied","Data":"0eb3e58042707277922b7c25a5fa12c4fd8d21d5fa366eb734ff1e8970f9f568"}
Jul 22 20:57:12.588411 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:12.588380    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f6h54"]
Jul 22 20:57:12.588505 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:12.588459    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:57:12.588567 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:12.588548    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6h54" podUID="e32f596b-8ead-471c-8e23-92b5816c3cd9"
Jul 22 20:57:12.590967 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:12.590930    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-snfgw"]
Jul 22 20:57:12.591052 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:12.591031    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:57:12.591157 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:12.591136    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snfgw" podUID="39625b20-2f3e-4c8c-975a-2896fd53f18a"
Jul 22 20:57:12.591497 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:12.591462    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-84495"]
Jul 22 20:57:12.591569 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:12.591540    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:57:12.591644 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:12.591625    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84495" podUID="091e389d-9d92-429c-a165-cf119fbfa842"
Jul 22 20:57:14.162478 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:14.162447    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mhtkv"
Jul 22 20:57:14.162925 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:14.162584    2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 22 20:57:14.163004 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:14.162986    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mhtkv"
Jul 22 20:57:14.404121 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:14.404089    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:57:14.404267 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:14.404126    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:57:14.404267 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:14.404138    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:57:14.404267 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:14.404230    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84495" podUID="091e389d-9d92-429c-a165-cf119fbfa842"
Jul 22 20:57:14.404495 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:14.404298    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snfgw" podUID="39625b20-2f3e-4c8c-975a-2896fd53f18a"
Jul 22 20:57:14.404495 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:14.404368    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6h54" podUID="e32f596b-8ead-471c-8e23-92b5816c3cd9"
Jul 22 20:57:14.537765 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:14.537694    2583 generic.go:356] "Generic (PLEG): container finished" podID="1b1bf362-79df-4816-848b-b825bde19b3e" containerID="cca222858a6edee5cdf4cb84aec200b66cbff11655e933e45211b057be3ffa5e" exitCode=0
Jul 22 20:57:14.537765 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:14.537733    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw8rc" event={"ID":"1b1bf362-79df-4816-848b-b825bde19b3e","Type":"ContainerDied","Data":"cca222858a6edee5cdf4cb84aec200b66cbff11655e933e45211b057be3ffa5e"}
Jul 22 20:57:16.071995 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.071898    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs\") pod \"network-metrics-daemon-f6h54\" (UID: \"e32f596b-8ead-471c-8e23-92b5816c3cd9\") " pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:57:16.072437 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:16.072031    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:57:16.072437 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:16.072086    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs podName:e32f596b-8ead-471c-8e23-92b5816c3cd9 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:48.07207271 +0000 UTC m=+66.096111266 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs") pod "network-metrics-daemon-f6h54" (UID: "e32f596b-8ead-471c-8e23-92b5816c3cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:57:16.172633 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.172591    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxhsx\" (UniqueName: \"kubernetes.io/projected/39625b20-2f3e-4c8c-975a-2896fd53f18a-kube-api-access-zxhsx\") pod \"network-check-target-snfgw\" (UID: \"39625b20-2f3e-4c8c-975a-2896fd53f18a\") " pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:57:16.172799 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.172659    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091e389d-9d92-429c-a165-cf119fbfa842-original-pull-secret\") pod \"global-pull-secret-syncer-84495\" (UID: \"091e389d-9d92-429c-a165-cf119fbfa842\") " pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:57:16.172799 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:16.172746    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 20:57:16.172799 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:16.172747    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 20:57:16.172799 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:16.172768    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 20:57:16.172799 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:16.172781    2583 projected.go:196] Error preparing data for projected volume kube-api-access-zxhsx for pod openshift-network-diagnostics/network-check-target-snfgw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:57:16.172799 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:16.172788    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091e389d-9d92-429c-a165-cf119fbfa842-original-pull-secret podName:091e389d-9d92-429c-a165-cf119fbfa842 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:48.172776858 +0000 UTC m=+66.196815415 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/091e389d-9d92-429c-a165-cf119fbfa842-original-pull-secret") pod "global-pull-secret-syncer-84495" (UID: "091e389d-9d92-429c-a165-cf119fbfa842") : object "kube-system"/"original-pull-secret" not registered
Jul 22 20:57:16.173143 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:16.172827    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39625b20-2f3e-4c8c-975a-2896fd53f18a-kube-api-access-zxhsx podName:39625b20-2f3e-4c8c-975a-2896fd53f18a nodeName:}" failed. No retries permitted until 2026-07-22 20:57:48.172813143 +0000 UTC m=+66.196851707 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxhsx" (UniqueName: "kubernetes.io/projected/39625b20-2f3e-4c8c-975a-2896fd53f18a-kube-api-access-zxhsx") pod "network-check-target-snfgw" (UID: "39625b20-2f3e-4c8c-975a-2896fd53f18a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:57:16.404708 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.404383    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:57:16.404708 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.404394    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:57:16.404708 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:16.404498    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snfgw" podUID="39625b20-2f3e-4c8c-975a-2896fd53f18a"
Jul 22 20:57:16.404708 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:16.404551    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6h54" podUID="e32f596b-8ead-471c-8e23-92b5816c3cd9"
Jul 22 20:57:16.404708 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.404565    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:57:16.404708 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:16.404651    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84495" podUID="091e389d-9d92-429c-a165-cf119fbfa842"
Jul 22 20:57:16.852949 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.852920    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeReady"
Jul 22 20:57:16.853152 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.853090    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 20:57:16.905837 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.905786    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64fff5d94d-gdhz6"]
Jul 22 20:57:16.908619 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.908599    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:16.913159 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.913134    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 22 20:57:16.913533 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.913507    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 22 20:57:16.913533 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.913528    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b7lth\""
Jul 22 20:57:16.913659 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.913598    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 22 20:57:16.920773 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.920754    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 22 20:57:16.929264 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.929239    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4bw2q"]
Jul 22 20:57:16.948460 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.948430    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24"]
Jul 22 20:57:16.948573 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.948558    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4bw2q"
Jul 22 20:57:16.951178 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.951158    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6fmcx\""
Jul 22 20:57:16.951481 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.951460    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 20:57:16.951572 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.951496    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 20:57:16.966173 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.966153    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64fff5d94d-gdhz6"]
Jul 22 20:57:16.966266 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.966183    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24"]
Jul 22 20:57:16.966266 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.966197    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4bw2q"]
Jul 22 20:57:16.966266 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.966202    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24"
Jul 22 20:57:16.966266 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.966217    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j2zwd"]
Jul 22 20:57:16.968532 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.968513    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 22 20:57:16.968764 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.968743    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 22 20:57:16.968764 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.968763    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9s96p\""
Jul 22 20:57:16.980234 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.980217    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j2zwd"]
Jul 22 20:57:16.980338 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.980295    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j2zwd"
Jul 22 20:57:16.982880 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.982860    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 20:57:16.982979 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.982925    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 20:57:16.983082 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.983065    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5ll7d\""
Jul 22 20:57:16.983152 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:16.983065    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 20:57:17.078836 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.078805    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-trusted-ca\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:17.078836 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.078839    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdhvt\" (UniqueName: \"kubernetes.io/projected/06dcf1b9-ea23-4842-8fcc-a5e8295407df-kube-api-access-xdhvt\") pod \"ingress-canary-j2zwd\" (UID: \"06dcf1b9-ea23-4842-8fcc-a5e8295407df\") " pod="openshift-ingress-canary/ingress-canary-j2zwd"
Jul 22 20:57:17.079336 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.078856    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c0af42d4-27c6-437d-9fdf-06f88118e432-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-5mn24\" (UID: \"c0af42d4-27c6-437d-9fdf-06f88118e432\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24"
Jul 22 20:57:17.079336 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.078909    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c68b0c1-3f71-40fe-b12a-1122487bfec5-tmp-dir\") pod \"dns-default-4bw2q\" (UID: \"3c68b0c1-3f71-40fe-b12a-1122487bfec5\") " pod="openshift-dns/dns-default-4bw2q"
Jul 22 20:57:17.079336 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.078938    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt22q\" (UniqueName: \"kubernetes.io/projected/3c68b0c1-3f71-40fe-b12a-1122487bfec5-kube-api-access-pt22q\") pod \"dns-default-4bw2q\" (UID: \"3c68b0c1-3f71-40fe-b12a-1122487bfec5\") " pod="openshift-dns/dns-default-4bw2q"
Jul 22 20:57:17.079336 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.079052    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c68b0c1-3f71-40fe-b12a-1122487bfec5-config-volume\") pod \"dns-default-4bw2q\" (UID: \"3c68b0c1-3f71-40fe-b12a-1122487bfec5\") " pod="openshift-dns/dns-default-4bw2q"
Jul 22 20:57:17.079336 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.079148    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5mn24\" (UID: \"c0af42d4-27c6-437d-9fdf-06f88118e432\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24"
Jul 22 20:57:17.079336 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.079177    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-bound-sa-token\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:17.079336 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.079200    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06dcf1b9-ea23-4842-8fcc-a5e8295407df-cert\") pod \"ingress-canary-j2zwd\" (UID: \"06dcf1b9-ea23-4842-8fcc-a5e8295407df\") " pod="openshift-ingress-canary/ingress-canary-j2zwd"
Jul 22 20:57:17.079336 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.079227    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:17.079336 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.079245    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-installation-pull-secrets\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:17.079336 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.079272    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-certificates\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:17.079336 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.079291    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-ca-trust-extracted\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:17.079336 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.079320    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls\") pod \"dns-default-4bw2q\" (UID: \"3c68b0c1-3f71-40fe-b12a-1122487bfec5\") " pod="openshift-dns/dns-default-4bw2q"
Jul 22 20:57:17.079723 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.079349    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-image-registry-private-configuration\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:17.079723 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.079405    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9kn6\" (UniqueName: \"kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-kube-api-access-t9kn6\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:17.141029 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.140983    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mhtkv_d8ee72b3-bea8-4a9a-8254-8bf3ed035489/konnectivity-agent/0.log" limit=1024
Jul 22 20:57:17.180033 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.179997    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:17.180033 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.180028    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-installation-pull-secrets\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:17.180228 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.180066    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-certificates\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:17.180228 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.180091    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-ca-trust-extracted\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:17.180228 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.180158    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls\") pod \"dns-default-4bw2q\" (UID: \"3c68b0c1-3f71-40fe-b12a-1122487bfec5\") " pod="openshift-dns/dns-default-4bw2q"
Jul 22 20:57:17.180228 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.180177    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-image-registry-private-configuration\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:17.180387 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.180227    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9kn6\" (UniqueName: \"kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-kube-api-access-t9kn6\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:17.180387 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:17.180245    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 20:57:17.180387 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:17.180279    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 20:57:17.180387 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:17.180304    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64fff5d94d-gdhz6: secret "image-registry-tls" not found
Jul 22 20:57:17.180387 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:17.180348    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls podName:3c68b0c1-3f71-40fe-b12a-1122487bfec5 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:17.680324518 +0000 UTC m=+35.704363090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls") pod "dns-default-4bw2q" (UID: "3c68b0c1-3f71-40fe-b12a-1122487bfec5") : secret "dns-default-metrics-tls" not found
Jul 22 20:57:17.180387 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:17.180385    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls podName:7f3af114-071e-4ecb-98b3-c6b7de9ccfde nodeName:}" failed. No retries permitted until 2026-07-22 20:57:17.680362708 +0000 UTC m=+35.704401266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls") pod "image-registry-64fff5d94d-gdhz6" (UID: "7f3af114-071e-4ecb-98b3-c6b7de9ccfde") : secret "image-registry-tls" not found
Jul 22 20:57:17.180642 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.180264    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-trusted-ca\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:17.180642 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.180456    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdhvt\" (UniqueName: \"kubernetes.io/projected/06dcf1b9-ea23-4842-8fcc-a5e8295407df-kube-api-access-xdhvt\") pod \"ingress-canary-j2zwd\" (UID: \"06dcf1b9-ea23-4842-8fcc-a5e8295407df\") " pod="openshift-ingress-canary/ingress-canary-j2zwd"
Jul 22 20:57:17.180642 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.180531    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-ca-trust-extracted\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:17.180642 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.180530    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c0af42d4-27c6-437d-9fdf-06f88118e432-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-5mn24\" (UID: \"c0af42d4-27c6-437d-9fdf-06f88118e432\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24"
Jul 22 20:57:17.180642 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.180574    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c68b0c1-3f71-40fe-b12a-1122487bfec5-tmp-dir\") pod \"dns-default-4bw2q\" (UID: \"3c68b0c1-3f71-40fe-b12a-1122487bfec5\") " pod="openshift-dns/dns-default-4bw2q"
Jul 22 20:57:17.180642 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.180601    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt22q\" (UniqueName: \"kubernetes.io/projected/3c68b0c1-3f71-40fe-b12a-1122487bfec5-kube-api-access-pt22q\") pod \"dns-default-4bw2q\" (UID: \"3c68b0c1-3f71-40fe-b12a-1122487bfec5\") " pod="openshift-dns/dns-default-4bw2q"
Jul 22 20:57:17.180880 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.180698    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c68b0c1-3f71-40fe-b12a-1122487bfec5-config-volume\") pod \"dns-default-4bw2q\" (UID: \"3c68b0c1-3f71-40fe-b12a-1122487bfec5\") " pod="openshift-dns/dns-default-4bw2q"
Jul 22 20:57:17.180880 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.180798    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-certificates\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:17.180880 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.180836    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5mn24\" (UID: \"c0af42d4-27c6-437d-9fdf-06f88118e432\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24"
Jul 22 20:57:17.180880 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.180871    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-bound-sa-token\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:17.181041 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.180966    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06dcf1b9-ea23-4842-8fcc-a5e8295407df-cert\") pod \"ingress-canary-j2zwd\" (UID: \"06dcf1b9-ea23-4842-8fcc-a5e8295407df\") " pod="openshift-ingress-canary/ingress-canary-j2zwd"
Jul 22 20:57:17.181606 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.181166    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c68b0c1-3f71-40fe-b12a-1122487bfec5-tmp-dir\") pod \"dns-default-4bw2q\" (UID: \"3c68b0c1-3f71-40fe-b12a-1122487bfec5\") " pod="openshift-dns/dns-default-4bw2q"
Jul 22 20:57:17.181606 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.181435    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c68b0c1-3f71-40fe-b12a-1122487bfec5-config-volume\") pod \"dns-default-4bw2q\" (UID: \"3c68b0c1-3f71-40fe-b12a-1122487bfec5\") " pod="openshift-dns/dns-default-4bw2q"
Jul 22 20:57:17.181606 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.181459    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c0af42d4-27c6-437d-9fdf-06f88118e432-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-5mn24\" (UID: \"c0af42d4-27c6-437d-9fdf-06f88118e432\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24"
Jul 22 20:57:17.181606 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:17.181618    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 20:57:17.182159 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:17.181708    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert podName:c0af42d4-27c6-437d-9fdf-06f88118e432 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:17.681691186 +0000 UTC m=+35.705729745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-5mn24" (UID: "c0af42d4-27c6-437d-9fdf-06f88118e432") : secret "networking-console-plugin-cert" not found
Jul 22 20:57:17.182159 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.182136    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-trusted-ca\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:17.185733 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.185613    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-installation-pull-secrets\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:17.185733 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.185721    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06dcf1b9-ea23-4842-8fcc-a5e8295407df-cert\") pod \"ingress-canary-j2zwd\" (UID: \"06dcf1b9-ea23-4842-8fcc-a5e8295407df\") " pod="openshift-ingress-canary/ingress-canary-j2zwd"
Jul 22 20:57:17.185733 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.185627    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-image-registry-private-configuration\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:17.209001 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.208961    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt22q\" (UniqueName: \"kubernetes.io/projected/3c68b0c1-3f71-40fe-b12a-1122487bfec5-kube-api-access-pt22q\") pod \"dns-default-4bw2q\" (UID: \"3c68b0c1-3f71-40fe-b12a-1122487bfec5\") " pod="openshift-dns/dns-default-4bw2q"
Jul 22 20:57:17.209094 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.209028    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9kn6\" (UniqueName: \"kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-kube-api-access-t9kn6\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:17.209689 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.209650    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdhvt\" (UniqueName: \"kubernetes.io/projected/06dcf1b9-ea23-4842-8fcc-a5e8295407df-kube-api-access-xdhvt\") pod \"ingress-canary-j2zwd\" (UID: \"06dcf1b9-ea23-4842-8fcc-a5e8295407df\") " pod="openshift-ingress-canary/ingress-canary-j2zwd"
Jul 22 20:57:17.209809 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.209792    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-bound-sa-token\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:17.278719 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.278641    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mhtkv_d8ee72b3-bea8-4a9a-8254-8bf3ed035489/konnectivity-agent/0.log" limit=1024
Jul 22 20:57:17.290631 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.290585    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j2zwd"
Jul 22 20:57:17.500084 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.500054    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j2zwd"]
Jul 22 20:57:17.506335 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:57:17.506309    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06dcf1b9_ea23_4842_8fcc_a5e8295407df.slice/crio-ed561c51b7ae225d93d0cc2dc5cd842745a596c3c561973b1f7c397b0688616e WatchSource:0}: Error finding container ed561c51b7ae225d93d0cc2dc5cd842745a596c3c561973b1f7c397b0688616e: Status 404 returned error can't find the container with id ed561c51b7ae225d93d0cc2dc5cd842745a596c3c561973b1f7c397b0688616e
Jul 22 20:57:17.546630 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.546547    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j2zwd" event={"ID":"06dcf1b9-ea23-4842-8fcc-a5e8295407df","Type":"ContainerStarted","Data":"ed561c51b7ae225d93d0cc2dc5cd842745a596c3c561973b1f7c397b0688616e"}
Jul 22 20:57:17.583597 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.583560    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mhtkv_d8ee72b3-bea8-4a9a-8254-8bf3ed035489/konnectivity-agent/0.log" limit=1024
Jul 22 20:57:17.684335 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.684300    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls\") pod \"dns-default-4bw2q\" (UID: \"3c68b0c1-3f71-40fe-b12a-1122487bfec5\") " pod="openshift-dns/dns-default-4bw2q"
Jul 22 20:57:17.684489 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.684399    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5mn24\" (UID: \"c0af42d4-27c6-437d-9fdf-06f88118e432\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24"
Jul 22 20:57:17.684489 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:17.684423    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:17.684489 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:17.684464    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 20:57:17.684577 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:17.684530    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls podName:3c68b0c1-3f71-40fe-b12a-1122487bfec5 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:18.684513878 +0000 UTC m=+36.708552434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls") pod "dns-default-4bw2q" (UID: "3c68b0c1-3f71-40fe-b12a-1122487bfec5") : secret "dns-default-metrics-tls" not found
Jul 22 20:57:17.684577 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:17.684532    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 20:57:17.684577 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:17.684533    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 20:57:17.684577 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:17.684546    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64fff5d94d-gdhz6: secret "image-registry-tls" not found
Jul 22 20:57:17.684693 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:17.684594    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls podName:7f3af114-071e-4ecb-98b3-c6b7de9ccfde nodeName:}" failed. No retries permitted until 2026-07-22 20:57:18.68457663 +0000 UTC m=+36.708615193 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls") pod "image-registry-64fff5d94d-gdhz6" (UID: "7f3af114-071e-4ecb-98b3-c6b7de9ccfde") : secret "image-registry-tls" not found
Jul 22 20:57:17.684693 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:17.684612    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert podName:c0af42d4-27c6-437d-9fdf-06f88118e432 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:18.684606336 +0000 UTC m=+36.708644892 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-5mn24" (UID: "c0af42d4-27c6-437d-9fdf-06f88118e432") : secret "networking-console-plugin-cert" not found
Jul 22 20:57:18.404078 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:18.404037    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:57:18.404857 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:18.404037    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:57:18.404857 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:18.404250    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:57:18.407685 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:18.407492    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 20:57:18.407685 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:18.407532    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 20:57:18.408295 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:18.408245    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j26qm\""
Jul 22 20:57:18.408393 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:18.408320    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 20:57:18.408393 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:18.408331    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 20:57:18.408489 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:18.408320    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bvpxr\""
Jul 22 20:57:18.693466 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:18.693400    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5mn24\" (UID: \"c0af42d4-27c6-437d-9fdf-06f88118e432\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24"
Jul 22 20:57:18.693466 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:18.693435    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:18.693678 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:18.693471    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls\") pod \"dns-default-4bw2q\" (UID: \"3c68b0c1-3f71-40fe-b12a-1122487bfec5\") " pod="openshift-dns/dns-default-4bw2q"
Jul 22 20:57:18.693678 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:18.693568    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 20:57:18.693678 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:18.693573    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 20:57:18.693678 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:18.693593    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64fff5d94d-gdhz6: secret "image-registry-tls" not found
Jul 22 20:57:18.693678 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:18.693619    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls podName:3c68b0c1-3f71-40fe-b12a-1122487bfec5 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:20.693605526 +0000 UTC m=+38.717644083 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls") pod "dns-default-4bw2q" (UID: "3c68b0c1-3f71-40fe-b12a-1122487bfec5") : secret "dns-default-metrics-tls" not found
Jul 22 20:57:18.693678 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:18.693652    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls podName:7f3af114-071e-4ecb-98b3-c6b7de9ccfde nodeName:}" failed. No retries permitted until 2026-07-22 20:57:20.693638947 +0000 UTC m=+38.717677504 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls") pod "image-registry-64fff5d94d-gdhz6" (UID: "7f3af114-071e-4ecb-98b3-c6b7de9ccfde") : secret "image-registry-tls" not found
Jul 22 20:57:18.693894 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:18.693572    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 20:57:18.693894 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:18.693740    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert podName:c0af42d4-27c6-437d-9fdf-06f88118e432 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:20.693726668 +0000 UTC m=+38.717765254 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-5mn24" (UID: "c0af42d4-27c6-437d-9fdf-06f88118e432") : secret "networking-console-plugin-cert" not found
Jul 22 20:57:20.556766 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:20.556511    2583 generic.go:356] "Generic (PLEG): container finished" podID="1b1bf362-79df-4816-848b-b825bde19b3e" containerID="8271790f9499d4a9c5e2e4302ec386d8e4576206209fa170c0e69dfcd9e30128" exitCode=0
Jul 22 20:57:20.557281 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:20.556590    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw8rc" event={"ID":"1b1bf362-79df-4816-848b-b825bde19b3e","Type":"ContainerDied","Data":"8271790f9499d4a9c5e2e4302ec386d8e4576206209fa170c0e69dfcd9e30128"}
Jul 22 20:57:20.718180 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:20.717999    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 20:57:20.718670 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:20.718643    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5mn24\" (UID: \"c0af42d4-27c6-437d-9fdf-06f88118e432\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24"
Jul 22 20:57:20.718766 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:20.718694    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:20.718766 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:20.718754    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls\") pod \"dns-default-4bw2q\" (UID: \"3c68b0c1-3f71-40fe-b12a-1122487bfec5\") " pod="openshift-dns/dns-default-4bw2q"
Jul 22 20:57:20.718961 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:20.718937    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert podName:c0af42d4-27c6-437d-9fdf-06f88118e432 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:24.718905813 +0000 UTC m=+42.742944386 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-5mn24" (UID: "c0af42d4-27c6-437d-9fdf-06f88118e432") : secret "networking-console-plugin-cert" not found
Jul 22 20:57:20.719292 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:20.719128    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 20:57:20.719292 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:20.719165    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64fff5d94d-gdhz6: secret "image-registry-tls" not found
Jul 22 20:57:20.719292 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:20.719214    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls podName:7f3af114-071e-4ecb-98b3-c6b7de9ccfde nodeName:}" failed. No retries permitted until 2026-07-22 20:57:24.719197911 +0000 UTC m=+42.743236469 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls") pod "image-registry-64fff5d94d-gdhz6" (UID: "7f3af114-071e-4ecb-98b3-c6b7de9ccfde") : secret "image-registry-tls" not found
Jul 22 20:57:20.719675 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:20.719598    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 20:57:20.719675 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:20.719656    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls podName:3c68b0c1-3f71-40fe-b12a-1122487bfec5 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:24.71964101 +0000 UTC m=+42.743679568 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls") pod "dns-default-4bw2q" (UID: "3c68b0c1-3f71-40fe-b12a-1122487bfec5") : secret "dns-default-metrics-tls" not found
Jul 22 20:57:21.565841 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:21.565491    2583 generic.go:356] "Generic (PLEG): container finished" podID="1b1bf362-79df-4816-848b-b825bde19b3e" containerID="c1fbfbb76f9deb53cbf0b0211993e3560208cef1a9da90bf27ccd5c6ff02e936" exitCode=0
Jul 22 20:57:21.565841 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:21.565563    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw8rc" event={"ID":"1b1bf362-79df-4816-848b-b825bde19b3e","Type":"ContainerDied","Data":"c1fbfbb76f9deb53cbf0b0211993e3560208cef1a9da90bf27ccd5c6ff02e936"}
Jul 22 20:57:22.571372 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:22.571286    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw8rc" event={"ID":"1b1bf362-79df-4816-848b-b825bde19b3e","Type":"ContainerStarted","Data":"683ea17489391707bb21ae23076d7c8322de85413f25569d9f740d1f1263eb98"}
Jul 22 20:57:22.572627 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:22.572608    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j2zwd" event={"ID":"06dcf1b9-ea23-4842-8fcc-a5e8295407df","Type":"ContainerStarted","Data":"f53956f26baed79fc1a2fa8fd78d24a1316274969f53a8931ec1176362ca3408"}
Jul 22 20:57:22.599457 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:22.599410    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tw8rc" podStartSLOduration=8.747104653 podStartE2EDuration="40.599396918s" totalImagesPullingTime="31.852292265s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:56:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:22.598758604 +0000 UTC m=+40.622797193" watchObservedRunningTime="2026-07-22 20:57:22.599396918 +0000 UTC m=+40.623435535"
Jul 22 20:57:22.614498 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:22.614451    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j2zwd" podStartSLOduration=1.951912782 podStartE2EDuration="6.61443818s" totalImagesPullingTime="4.662525398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:57:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:22.613771641 +0000 UTC m=+40.637810219" watchObservedRunningTime="2026-07-22 20:57:22.61443818 +0000 UTC m=+40.638476777"
Jul 22 20:57:24.751146 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:24.751091    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:24.751713 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:24.751171    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls\") pod \"dns-default-4bw2q\" (UID: \"3c68b0c1-3f71-40fe-b12a-1122487bfec5\") " pod="openshift-dns/dns-default-4bw2q"
Jul 22 20:57:24.751713 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:24.751252    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 20:57:24.751713 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:24.751275    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64fff5d94d-gdhz6: secret "image-registry-tls" not found
Jul 22 20:57:24.751713 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:24.751277    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5mn24\" (UID: \"c0af42d4-27c6-437d-9fdf-06f88118e432\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24"
Jul 22 20:57:24.751713 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:24.751313    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 20:57:24.751713 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:24.751331    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls podName:7f3af114-071e-4ecb-98b3-c6b7de9ccfde nodeName:}" failed. No retries permitted until 2026-07-22 20:57:32.751313237 +0000 UTC m=+50.775351793 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls") pod "image-registry-64fff5d94d-gdhz6" (UID: "7f3af114-071e-4ecb-98b3-c6b7de9ccfde") : secret "image-registry-tls" not found
Jul 22 20:57:24.751713 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:24.751360    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls podName:3c68b0c1-3f71-40fe-b12a-1122487bfec5 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:32.751347835 +0000 UTC m=+50.775386392 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls") pod "dns-default-4bw2q" (UID: "3c68b0c1-3f71-40fe-b12a-1122487bfec5") : secret "dns-default-metrics-tls" not found
Jul 22 20:57:24.751713 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:24.751378    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 20:57:24.751713 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:24.751443    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert podName:c0af42d4-27c6-437d-9fdf-06f88118e432 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:32.751429319 +0000 UTC m=+50.775467915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-5mn24" (UID: "c0af42d4-27c6-437d-9fdf-06f88118e432") : secret "networking-console-plugin-cert" not found
Jul 22 20:57:32.806311 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:32.806270    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5mn24\" (UID: \"c0af42d4-27c6-437d-9fdf-06f88118e432\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24"
Jul 22 20:57:32.806311 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:32.806310    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:32.806712 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:32.806338    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls\") pod \"dns-default-4bw2q\" (UID: \"3c68b0c1-3f71-40fe-b12a-1122487bfec5\") " pod="openshift-dns/dns-default-4bw2q"
Jul 22 20:57:32.806712 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:32.806438    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 20:57:32.806712 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:32.806437    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 20:57:32.806712 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:32.806494    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls podName:3c68b0c1-3f71-40fe-b12a-1122487bfec5 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:48.806477445 +0000 UTC m=+66.830516003 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls") pod "dns-default-4bw2q" (UID: "3c68b0c1-3f71-40fe-b12a-1122487bfec5") : secret "dns-default-metrics-tls" not found
Jul 22 20:57:32.806712 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:32.806529    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert podName:c0af42d4-27c6-437d-9fdf-06f88118e432 nodeName:}" failed. No retries permitted until 2026-07-22 20:57:48.806517713 +0000 UTC m=+66.830556273 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-5mn24" (UID: "c0af42d4-27c6-437d-9fdf-06f88118e432") : secret "networking-console-plugin-cert" not found
Jul 22 20:57:32.806712 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:32.806440    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 20:57:32.806712 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:32.806561    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64fff5d94d-gdhz6: secret "image-registry-tls" not found
Jul 22 20:57:32.806712 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:32.806617    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls podName:7f3af114-071e-4ecb-98b3-c6b7de9ccfde nodeName:}" failed. No retries permitted until 2026-07-22 20:57:48.806602258 +0000 UTC m=+66.830640814 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls") pod "image-registry-64fff5d94d-gdhz6" (UID: "7f3af114-071e-4ecb-98b3-c6b7de9ccfde") : secret "image-registry-tls" not found
Jul 22 20:57:43.543443 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:43.543416    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9gf8"
Jul 22 20:57:48.110694 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:48.110648    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs\") pod \"network-metrics-daemon-f6h54\" (UID: \"e32f596b-8ead-471c-8e23-92b5816c3cd9\") " pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:57:48.112926 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:48.112907    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 20:57:48.120874 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:48.120855    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 22 20:57:48.120938 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:48.120927    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs podName:e32f596b-8ead-471c-8e23-92b5816c3cd9 nodeName:}" failed. No retries permitted until 2026-07-22 20:58:52.120905387 +0000 UTC m=+130.144943967 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs") pod "network-metrics-daemon-f6h54" (UID: "e32f596b-8ead-471c-8e23-92b5816c3cd9") : secret "metrics-daemon-secret" not found
Jul 22 20:57:48.211217 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:48.211192    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091e389d-9d92-429c-a165-cf119fbfa842-original-pull-secret\") pod \"global-pull-secret-syncer-84495\" (UID: \"091e389d-9d92-429c-a165-cf119fbfa842\") " pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:57:48.211305 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:48.211257    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxhsx\" (UniqueName: \"kubernetes.io/projected/39625b20-2f3e-4c8c-975a-2896fd53f18a-kube-api-access-zxhsx\") pod \"network-check-target-snfgw\" (UID: \"39625b20-2f3e-4c8c-975a-2896fd53f18a\") " pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:57:48.214009 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:48.213991    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 20:57:48.214050 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:48.214005    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 20:57:48.224090 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:48.224074    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 20:57:48.225393 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:48.225374    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091e389d-9d92-429c-a165-cf119fbfa842-original-pull-secret\") pod \"global-pull-secret-syncer-84495\" (UID: \"091e389d-9d92-429c-a165-cf119fbfa842\") " pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:57:48.234904 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:48.234884    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxhsx\" (UniqueName: \"kubernetes.io/projected/39625b20-2f3e-4c8c-975a-2896fd53f18a-kube-api-access-zxhsx\") pod \"network-check-target-snfgw\" (UID: \"39625b20-2f3e-4c8c-975a-2896fd53f18a\") " pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:57:48.415721 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:48.415654    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84495"
Jul 22 20:57:48.426719 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:48.426686    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bvpxr\""
Jul 22 20:57:48.434852 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:48.434832    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:57:48.550868 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:48.550839    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-84495"]
Jul 22 20:57:48.555642 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:57:48.555520    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod091e389d_9d92_429c_a165_cf119fbfa842.slice/crio-3f6d9d2424681c39fd65d5a1c0d763e719c01c317792fa5e215c06499999baed WatchSource:0}: Error finding container 3f6d9d2424681c39fd65d5a1c0d763e719c01c317792fa5e215c06499999baed: Status 404 returned error can't find the container with id 3f6d9d2424681c39fd65d5a1c0d763e719c01c317792fa5e215c06499999baed
Jul 22 20:57:48.563009 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:48.562987    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-snfgw"]
Jul 22 20:57:48.571892 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:57:48.571873    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39625b20_2f3e_4c8c_975a_2896fd53f18a.slice/crio-f047c1ba47ce1711244293815512454414c50d08312ba09ac8d533021881d42a WatchSource:0}: Error finding container f047c1ba47ce1711244293815512454414c50d08312ba09ac8d533021881d42a: Status 404 returned error can't find the container with id f047c1ba47ce1711244293815512454414c50d08312ba09ac8d533021881d42a
Jul 22 20:57:48.633998 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:48.633968    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-84495" event={"ID":"091e389d-9d92-429c-a165-cf119fbfa842","Type":"ContainerStarted","Data":"3f6d9d2424681c39fd65d5a1c0d763e719c01c317792fa5e215c06499999baed"}
Jul 22 20:57:48.635038 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:48.635016    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-snfgw" event={"ID":"39625b20-2f3e-4c8c-975a-2896fd53f18a","Type":"ContainerStarted","Data":"f047c1ba47ce1711244293815512454414c50d08312ba09ac8d533021881d42a"}
Jul 22 20:57:48.817697 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:48.817621    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5mn24\" (UID: \"c0af42d4-27c6-437d-9fdf-06f88118e432\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24"
Jul 22 20:57:48.817697 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:48.817655    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:57:48.817697 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:48.817692    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls\") pod \"dns-default-4bw2q\" (UID: \"3c68b0c1-3f71-40fe-b12a-1122487bfec5\") " pod="openshift-dns/dns-default-4bw2q"
Jul 22 20:57:48.817928 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:48.817774    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 20:57:48.817928 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:48.817776    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 20:57:48.817928 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:48.817800    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 20:57:48.817928 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:48.817816    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64fff5d94d-gdhz6: secret "image-registry-tls" not found
Jul 22 20:57:48.817928 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:48.817822    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls podName:3c68b0c1-3f71-40fe-b12a-1122487bfec5 nodeName:}" failed. No retries permitted until 2026-07-22 20:58:20.817810078 +0000 UTC m=+98.841848635 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls") pod "dns-default-4bw2q" (UID: "3c68b0c1-3f71-40fe-b12a-1122487bfec5") : secret "dns-default-metrics-tls" not found
Jul 22 20:57:48.817928 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:48.817834    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert podName:c0af42d4-27c6-437d-9fdf-06f88118e432 nodeName:}" failed. No retries permitted until 2026-07-22 20:58:20.817829092 +0000 UTC m=+98.841867649 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-5mn24" (UID: "c0af42d4-27c6-437d-9fdf-06f88118e432") : secret "networking-console-plugin-cert" not found
Jul 22 20:57:48.817928 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:57:48.817861    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls podName:7f3af114-071e-4ecb-98b3-c6b7de9ccfde nodeName:}" failed. No retries permitted until 2026-07-22 20:58:20.817843786 +0000 UTC m=+98.841882360 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls") pod "image-registry-64fff5d94d-gdhz6" (UID: "7f3af114-071e-4ecb-98b3-c6b7de9ccfde") : secret "image-registry-tls" not found
Jul 22 20:57:53.648029 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:53.647993    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-snfgw" event={"ID":"39625b20-2f3e-4c8c-975a-2896fd53f18a","Type":"ContainerStarted","Data":"0e7575e8bc433d84abaf287f9a3788c7743a50d68de669aa3bcff2393f7baebd"}
Jul 22 20:57:53.648536 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:53.648137    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:57:53.649384 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:53.649365    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-84495" event={"ID":"091e389d-9d92-429c-a165-cf119fbfa842","Type":"ContainerStarted","Data":"2b382bcea13744541f0e010842e0c7395f2076afef5851d5e1f22b832c1402f5"}
Jul 22 20:57:53.663011 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:53.662967    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-snfgw" podStartSLOduration=66.204911148 podStartE2EDuration="1m10.662955947s" totalImagesPullingTime="4.458044799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:56:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:53.662862265 +0000 UTC m=+71.686900848" watchObservedRunningTime="2026-07-22 20:57:53.662955947 +0000 UTC m=+71.686994526"
Jul 22 20:57:53.676298 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:57:53.676247    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-84495" podStartSLOduration=66.197472904 podStartE2EDuration="1m10.676231172s" totalImagesPullingTime="4.478758268s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:56:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:57:53.676069086 +0000 UTC m=+71.700107666" watchObservedRunningTime="2026-07-22 20:57:53.676231172 +0000 UTC m=+71.700269750"
Jul 22 20:58:04.719175 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.719007    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw"]
Jul 22 20:58:04.722343 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.722322    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw"
Jul 22 20:58:04.724652 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.724631    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 22 20:58:04.725416 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.725393    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 22 20:58:04.725657 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.725626    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 22 20:58:04.725657 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.725657    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 22 20:58:04.725825 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.725675    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 22 20:58:04.725825 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.725706    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 22 20:58:04.726292 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.726262    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 22 20:58:04.733512 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.733492    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw"]
Jul 22 20:58:04.822328 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.822307    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5603dbd-75ff-45cf-9588-9a5bb64c334b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8675f786c4-69nfw\" (UID: \"e5603dbd-75ff-45cf-9588-9a5bb64c334b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw"
Jul 22 20:58:04.822435 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.822350    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e5603dbd-75ff-45cf-9588-9a5bb64c334b-hub\") pod \"cluster-proxy-proxy-agent-8675f786c4-69nfw\" (UID: \"e5603dbd-75ff-45cf-9588-9a5bb64c334b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw"
Jul 22 20:58:04.822435 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.822369    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e5603dbd-75ff-45cf-9588-9a5bb64c334b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8675f786c4-69nfw\" (UID: \"e5603dbd-75ff-45cf-9588-9a5bb64c334b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw"
Jul 22 20:58:04.822435 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.822393    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e5603dbd-75ff-45cf-9588-9a5bb64c334b-ca\") pod \"cluster-proxy-proxy-agent-8675f786c4-69nfw\" (UID: \"e5603dbd-75ff-45cf-9588-9a5bb64c334b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw"
Jul 22 20:58:04.822435 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.822408    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxrp2\" (UniqueName: \"kubernetes.io/projected/e5603dbd-75ff-45cf-9588-9a5bb64c334b-kube-api-access-kxrp2\") pod \"cluster-proxy-proxy-agent-8675f786c4-69nfw\" (UID: \"e5603dbd-75ff-45cf-9588-9a5bb64c334b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw"
Jul 22 20:58:04.822615 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.822514    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e5603dbd-75ff-45cf-9588-9a5bb64c334b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8675f786c4-69nfw\" (UID: \"e5603dbd-75ff-45cf-9588-9a5bb64c334b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw"
Jul 22 20:58:04.923399 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.923371    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e5603dbd-75ff-45cf-9588-9a5bb64c334b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8675f786c4-69nfw\" (UID: \"e5603dbd-75ff-45cf-9588-9a5bb64c334b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw"
Jul 22 20:58:04.923508 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.923413    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5603dbd-75ff-45cf-9588-9a5bb64c334b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8675f786c4-69nfw\" (UID: \"e5603dbd-75ff-45cf-9588-9a5bb64c334b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw"
Jul 22 20:58:04.923508 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.923444    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e5603dbd-75ff-45cf-9588-9a5bb64c334b-hub\") pod \"cluster-proxy-proxy-agent-8675f786c4-69nfw\" (UID: \"e5603dbd-75ff-45cf-9588-9a5bb64c334b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw"
Jul 22 20:58:04.923508 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.923462    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e5603dbd-75ff-45cf-9588-9a5bb64c334b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8675f786c4-69nfw\" (UID: \"e5603dbd-75ff-45cf-9588-9a5bb64c334b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw"
Jul 22 20:58:04.923508 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.923495    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e5603dbd-75ff-45cf-9588-9a5bb64c334b-ca\") pod \"cluster-proxy-proxy-agent-8675f786c4-69nfw\" (UID: \"e5603dbd-75ff-45cf-9588-9a5bb64c334b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw"
Jul 22 20:58:04.923508 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.923511    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxrp2\" (UniqueName: \"kubernetes.io/projected/e5603dbd-75ff-45cf-9588-9a5bb64c334b-kube-api-access-kxrp2\") pod \"cluster-proxy-proxy-agent-8675f786c4-69nfw\" (UID: \"e5603dbd-75ff-45cf-9588-9a5bb64c334b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw"
Jul 22 20:58:04.924062 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.924025    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5603dbd-75ff-45cf-9588-9a5bb64c334b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8675f786c4-69nfw\" (UID: \"e5603dbd-75ff-45cf-9588-9a5bb64c334b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw"
Jul 22 20:58:04.926268 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.926238    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e5603dbd-75ff-45cf-9588-9a5bb64c334b-ca\") pod \"cluster-proxy-proxy-agent-8675f786c4-69nfw\" (UID: \"e5603dbd-75ff-45cf-9588-9a5bb64c334b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw"
Jul 22 20:58:04.926378 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.926339    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e5603dbd-75ff-45cf-9588-9a5bb64c334b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8675f786c4-69nfw\" (UID: \"e5603dbd-75ff-45cf-9588-9a5bb64c334b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw"
Jul 22 20:58:04.926378 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.926336    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e5603dbd-75ff-45cf-9588-9a5bb64c334b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8675f786c4-69nfw\" (UID: \"e5603dbd-75ff-45cf-9588-9a5bb64c334b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw"
Jul 22 20:58:04.926464 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.926406    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e5603dbd-75ff-45cf-9588-9a5bb64c334b-hub\") pod \"cluster-proxy-proxy-agent-8675f786c4-69nfw\" (UID: \"e5603dbd-75ff-45cf-9588-9a5bb64c334b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw"
Jul 22 20:58:04.931451 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:04.931426    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxrp2\" (UniqueName: \"kubernetes.io/projected/e5603dbd-75ff-45cf-9588-9a5bb64c334b-kube-api-access-kxrp2\") pod \"cluster-proxy-proxy-agent-8675f786c4-69nfw\" (UID: \"e5603dbd-75ff-45cf-9588-9a5bb64c334b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw"
Jul 22 20:58:05.054234 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:05.054175    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw"
Jul 22 20:58:05.181733 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:05.181706    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw"]
Jul 22 20:58:05.184369 ip-10-0-133-4 kubenswrapper[2583]: W0722 20:58:05.184340    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5603dbd_75ff_45cf_9588_9a5bb64c334b.slice/crio-b3de6f86eac143e9e7bcc6ffb2b994c310567bfe2d20b8e74208738b945012a2 WatchSource:0}: Error finding container b3de6f86eac143e9e7bcc6ffb2b994c310567bfe2d20b8e74208738b945012a2: Status 404 returned error can't find the container with id b3de6f86eac143e9e7bcc6ffb2b994c310567bfe2d20b8e74208738b945012a2
Jul 22 20:58:05.677503 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:05.677467    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw" event={"ID":"e5603dbd-75ff-45cf-9588-9a5bb64c334b","Type":"ContainerStarted","Data":"b3de6f86eac143e9e7bcc6ffb2b994c310567bfe2d20b8e74208738b945012a2"}
Jul 22 20:58:09.694972 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:09.694940    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw" event={"ID":"e5603dbd-75ff-45cf-9588-9a5bb64c334b","Type":"ContainerStarted","Data":"870277205c7320a3596f3be66af0971e8aa7d35d4cc3e5a9107b08433cafcd49"}
Jul 22 20:58:09.695460 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:09.694986    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw" event={"ID":"e5603dbd-75ff-45cf-9588-9a5bb64c334b","Type":"ContainerStarted","Data":"84ecb9fb60c23d2647b682afbf7def42cb2769c9180a07d3177f5b547d8db46f"}
Jul 22 20:58:09.695460 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:09.695002    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw" event={"ID":"e5603dbd-75ff-45cf-9588-9a5bb64c334b","Type":"ContainerStarted","Data":"3f11ce6dccde20a7a296f341868ff2a1db8805baa9752ebab167f8b96ef6c90c"}
Jul 22 20:58:09.712361 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:09.712315    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw" podStartSLOduration=2.093246796 podStartE2EDuration="5.712301789s" totalImagesPullingTime="3.619054993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:58:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:58:09.712277102 +0000 UTC m=+87.736315680" watchObservedRunningTime="2026-07-22 20:58:09.712301789 +0000 UTC m=+87.736340364"
Jul 22 20:58:20.836745 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:20.836690    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5mn24\" (UID: \"c0af42d4-27c6-437d-9fdf-06f88118e432\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24"
Jul 22 20:58:20.836745 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:20.836750    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:58:20.837206 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:20.836781    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls\") pod \"dns-default-4bw2q\" (UID: \"3c68b0c1-3f71-40fe-b12a-1122487bfec5\") " pod="openshift-dns/dns-default-4bw2q"
Jul 22 20:58:20.837206 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:58:20.836842    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 20:58:20.837206 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:58:20.836871    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 20:58:20.837206 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:58:20.836911    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert podName:c0af42d4-27c6-437d-9fdf-06f88118e432 nodeName:}" failed. No retries permitted until 2026-07-22 20:59:24.836894965 +0000 UTC m=+162.860933523 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-5mn24" (UID: "c0af42d4-27c6-437d-9fdf-06f88118e432") : secret "networking-console-plugin-cert" not found
Jul 22 20:58:20.837206 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:58:20.836926    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls podName:3c68b0c1-3f71-40fe-b12a-1122487bfec5 nodeName:}" failed. No retries permitted until 2026-07-22 20:59:24.836919433 +0000 UTC m=+162.860957989 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls") pod "dns-default-4bw2q" (UID: "3c68b0c1-3f71-40fe-b12a-1122487bfec5") : secret "dns-default-metrics-tls" not found
Jul 22 20:58:20.837206 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:58:20.836929    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 20:58:20.837206 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:58:20.836945    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64fff5d94d-gdhz6: secret "image-registry-tls" not found
Jul 22 20:58:20.837206 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:58:20.837010    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls podName:7f3af114-071e-4ecb-98b3-c6b7de9ccfde nodeName:}" failed. No retries permitted until 2026-07-22 20:59:24.836994775 +0000 UTC m=+162.861033338 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls") pod "image-registry-64fff5d94d-gdhz6" (UID: "7f3af114-071e-4ecb-98b3-c6b7de9ccfde") : secret "image-registry-tls" not found
Jul 22 20:58:24.654428 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:24.654394    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-snfgw"
Jul 22 20:58:52.151281 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:58:52.151242    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs\") pod \"network-metrics-daemon-f6h54\" (UID: \"e32f596b-8ead-471c-8e23-92b5816c3cd9\") " pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 20:58:52.151804 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:58:52.151392    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 22 20:58:52.151804 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:58:52.151479    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs podName:e32f596b-8ead-471c-8e23-92b5816c3cd9 nodeName:}" failed. No retries permitted until 2026-07-22 21:00:54.151457731 +0000 UTC m=+252.175496332 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs") pod "network-metrics-daemon-f6h54" (UID: "e32f596b-8ead-471c-8e23-92b5816c3cd9") : secret "metrics-daemon-secret" not found
Jul 22 20:59:19.921891 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:59:19.921845    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6" podUID="7f3af114-071e-4ecb-98b3-c6b7de9ccfde"
Jul 22 20:59:19.958293 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:59:19.958254    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4bw2q" podUID="3c68b0c1-3f71-40fe-b12a-1122487bfec5"
Jul 22 20:59:19.976400 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:59:19.976372    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24" podUID="c0af42d4-27c6-437d-9fdf-06f88118e432"
Jul 22 20:59:20.897544 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:59:20.897515    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4bw2q"
Jul 22 20:59:20.897712 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:59:20.897516    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:59:20.897712 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:59:20.897516    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24"
Jul 22 20:59:21.428508 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:59:21.428469    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-f6h54" podUID="e32f596b-8ead-471c-8e23-92b5816c3cd9"
Jul 22 20:59:24.882430 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:59:24.882392    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 20:59:24.882803 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:59:24.882443    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls\") pod \"dns-default-4bw2q\" (UID: \"3c68b0c1-3f71-40fe-b12a-1122487bfec5\") " pod="openshift-dns/dns-default-4bw2q"
Jul 22 20:59:24.882803 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:59:24.882494    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5mn24\" (UID: \"c0af42d4-27c6-437d-9fdf-06f88118e432\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24"
Jul 22 20:59:24.882803 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:59:24.882555    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 20:59:24.882803 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:59:24.882574    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 20:59:24.882803 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:59:24.882580    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64fff5d94d-gdhz6: secret "image-registry-tls" not found
Jul 22 20:59:24.882803 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:59:24.882587    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 20:59:24.882803 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:59:24.882641    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls podName:7f3af114-071e-4ecb-98b3-c6b7de9ccfde nodeName:}" failed. No retries permitted until 2026-07-22 21:01:26.88262481 +0000 UTC m=+284.906663367 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls") pod "image-registry-64fff5d94d-gdhz6" (UID: "7f3af114-071e-4ecb-98b3-c6b7de9ccfde") : secret "image-registry-tls" not found
Jul 22 20:59:24.882803 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:59:24.882657    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert podName:c0af42d4-27c6-437d-9fdf-06f88118e432 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:26.882649701 +0000 UTC m=+284.906688257 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-5mn24" (UID: "c0af42d4-27c6-437d-9fdf-06f88118e432") : secret "networking-console-plugin-cert" not found
Jul 22 20:59:24.882803 ip-10-0-133-4 kubenswrapper[2583]: E0722 20:59:24.882666    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls podName:3c68b0c1-3f71-40fe-b12a-1122487bfec5 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:26.882661928 +0000 UTC m=+284.906700485 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls") pod "dns-default-4bw2q" (UID: "3c68b0c1-3f71-40fe-b12a-1122487bfec5") : secret "dns-default-metrics-tls" not found
Jul 22 20:59:36.404305 ip-10-0-133-4 kubenswrapper[2583]: I0722 20:59:36.404217    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 21:00:54.189041 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:00:54.188998    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs\") pod \"network-metrics-daemon-f6h54\" (UID: \"e32f596b-8ead-471c-8e23-92b5816c3cd9\") " pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 21:00:54.189545 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:00:54.189164    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 22 21:00:54.189545 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:00:54.189266    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs podName:e32f596b-8ead-471c-8e23-92b5816c3cd9 nodeName:}" failed. No retries permitted until 2026-07-22 21:02:56.189246093 +0000 UTC m=+374.213284667 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs") pod "network-metrics-daemon-f6h54" (UID: "e32f596b-8ead-471c-8e23-92b5816c3cd9") : secret "metrics-daemon-secret" not found
Jul 22 21:01:12.040347 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:12.040308    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-872zt"]
Jul 22 21:01:12.043421 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:12.043400    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:12.045943 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:12.045910    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 21:01:12.045943 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:12.045932    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 21:01:12.046148 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:12.045974    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jvwv8\""
Jul 22 21:01:12.046454 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:12.046427    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 21:01:12.046580 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:12.046429    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 21:01:12.054215 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:12.054191    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-872zt"]
Jul 22 21:01:12.113644 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:12.113618    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9969fddd-5eb8-4fd1-9ae9-089741d40478-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:12.113757 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:12.113650    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9969fddd-5eb8-4fd1-9ae9-089741d40478-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:12.113757 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:12.113710    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9969fddd-5eb8-4fd1-9ae9-089741d40478-data-volume\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:12.113844 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:12.113767    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snh9l\" (UniqueName: \"kubernetes.io/projected/9969fddd-5eb8-4fd1-9ae9-089741d40478-kube-api-access-snh9l\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:12.113844 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:12.113798    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9969fddd-5eb8-4fd1-9ae9-089741d40478-crio-socket\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:12.214469 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:12.214437    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snh9l\" (UniqueName: \"kubernetes.io/projected/9969fddd-5eb8-4fd1-9ae9-089741d40478-kube-api-access-snh9l\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:12.214570 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:12.214489    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9969fddd-5eb8-4fd1-9ae9-089741d40478-crio-socket\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:12.214570 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:12.214540    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9969fddd-5eb8-4fd1-9ae9-089741d40478-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:12.214570 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:12.214565    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9969fddd-5eb8-4fd1-9ae9-089741d40478-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:12.214705 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:12.214599    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9969fddd-5eb8-4fd1-9ae9-089741d40478-crio-socket\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:12.214705 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:12.214608    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9969fddd-5eb8-4fd1-9ae9-089741d40478-data-volume\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:12.214705 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:12.214676    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 21:01:12.214705 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:12.214689    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 21:01:12.214881 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:12.214762    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9969fddd-5eb8-4fd1-9ae9-089741d40478-insights-runtime-extractor-tls podName:9969fddd-5eb8-4fd1-9ae9-089741d40478 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:12.714742415 +0000 UTC m=+270.738781008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9969fddd-5eb8-4fd1-9ae9-089741d40478-insights-runtime-extractor-tls") pod "insights-runtime-extractor-872zt" (UID: "9969fddd-5eb8-4fd1-9ae9-089741d40478") : secret "insights-runtime-extractor-tls" not found
Jul 22 21:01:12.214881 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:12.214801    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9969fddd-5eb8-4fd1-9ae9-089741d40478-kube-rbac-proxy-cm podName:9969fddd-5eb8-4fd1-9ae9-089741d40478 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:12.714771799 +0000 UTC m=+270.738810603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9969fddd-5eb8-4fd1-9ae9-089741d40478-kube-rbac-proxy-cm") pod "insights-runtime-extractor-872zt" (UID: "9969fddd-5eb8-4fd1-9ae9-089741d40478") : configmap "kube-rbac-proxy" not found
Jul 22 21:01:12.214960 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:12.214923    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9969fddd-5eb8-4fd1-9ae9-089741d40478-data-volume\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:12.223971 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:12.223946    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snh9l\" (UniqueName: \"kubernetes.io/projected/9969fddd-5eb8-4fd1-9ae9-089741d40478-kube-api-access-snh9l\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:12.718015 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:12.717971    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9969fddd-5eb8-4fd1-9ae9-089741d40478-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:12.718015 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:12.718018    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9969fddd-5eb8-4fd1-9ae9-089741d40478-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:12.718297 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:12.718092    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 21:01:12.718297 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:12.718167    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9969fddd-5eb8-4fd1-9ae9-089741d40478-kube-rbac-proxy-cm podName:9969fddd-5eb8-4fd1-9ae9-089741d40478 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:13.718152715 +0000 UTC m=+271.742191271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9969fddd-5eb8-4fd1-9ae9-089741d40478-kube-rbac-proxy-cm") pod "insights-runtime-extractor-872zt" (UID: "9969fddd-5eb8-4fd1-9ae9-089741d40478") : configmap "kube-rbac-proxy" not found
Jul 22 21:01:12.718297 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:12.718167    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 21:01:12.718297 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:12.718260    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9969fddd-5eb8-4fd1-9ae9-089741d40478-insights-runtime-extractor-tls podName:9969fddd-5eb8-4fd1-9ae9-089741d40478 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:13.7182384 +0000 UTC m=+271.742276961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9969fddd-5eb8-4fd1-9ae9-089741d40478-insights-runtime-extractor-tls") pod "insights-runtime-extractor-872zt" (UID: "9969fddd-5eb8-4fd1-9ae9-089741d40478") : secret "insights-runtime-extractor-tls" not found
Jul 22 21:01:13.724682 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:13.724642    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9969fddd-5eb8-4fd1-9ae9-089741d40478-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:13.725159 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:13.724688    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9969fddd-5eb8-4fd1-9ae9-089741d40478-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:13.725159 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:13.724784    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 21:01:13.725159 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:13.724829    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 21:01:13.725159 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:13.724851    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9969fddd-5eb8-4fd1-9ae9-089741d40478-insights-runtime-extractor-tls podName:9969fddd-5eb8-4fd1-9ae9-089741d40478 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:15.724833703 +0000 UTC m=+273.748872261 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9969fddd-5eb8-4fd1-9ae9-089741d40478-insights-runtime-extractor-tls") pod "insights-runtime-extractor-872zt" (UID: "9969fddd-5eb8-4fd1-9ae9-089741d40478") : secret "insights-runtime-extractor-tls" not found
Jul 22 21:01:13.725159 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:13.724904    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9969fddd-5eb8-4fd1-9ae9-089741d40478-kube-rbac-proxy-cm podName:9969fddd-5eb8-4fd1-9ae9-089741d40478 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:15.724885523 +0000 UTC m=+273.748924087 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9969fddd-5eb8-4fd1-9ae9-089741d40478-kube-rbac-proxy-cm") pod "insights-runtime-extractor-872zt" (UID: "9969fddd-5eb8-4fd1-9ae9-089741d40478") : configmap "kube-rbac-proxy" not found
Jul 22 21:01:14.931613 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:14.931585    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dfp6m_3c52e7ef-2939-4ccc-9b94-ad30fe6e6a15/dns-node-resolver/0.log"
Jul 22 21:01:15.738200 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:15.738139    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9969fddd-5eb8-4fd1-9ae9-089741d40478-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:15.738200 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:15.738206    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9969fddd-5eb8-4fd1-9ae9-089741d40478-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:15.738464 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:15.738328    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 21:01:15.738464 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:15.738341    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 21:01:15.738464 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:15.738416    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9969fddd-5eb8-4fd1-9ae9-089741d40478-insights-runtime-extractor-tls podName:9969fddd-5eb8-4fd1-9ae9-089741d40478 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:19.738396778 +0000 UTC m=+277.762435335 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9969fddd-5eb8-4fd1-9ae9-089741d40478-insights-runtime-extractor-tls") pod "insights-runtime-extractor-872zt" (UID: "9969fddd-5eb8-4fd1-9ae9-089741d40478") : secret "insights-runtime-extractor-tls" not found
Jul 22 21:01:15.738464 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:15.738431    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9969fddd-5eb8-4fd1-9ae9-089741d40478-kube-rbac-proxy-cm podName:9969fddd-5eb8-4fd1-9ae9-089741d40478 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:19.738425306 +0000 UTC m=+277.762463862 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9969fddd-5eb8-4fd1-9ae9-089741d40478-kube-rbac-proxy-cm") pod "insights-runtime-extractor-872zt" (UID: "9969fddd-5eb8-4fd1-9ae9-089741d40478") : configmap "kube-rbac-proxy" not found
Jul 22 21:01:15.931250 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:15.931222    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c297s_9b14274a-0241-464a-876e-a6ec2f7c8d9e/node-ca/0.log"
Jul 22 21:01:16.531191 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:16.531160    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j2zwd_06dcf1b9-ea23-4842-8fcc-a5e8295407df/serve-healthcheck-canary/0.log"
Jul 22 21:01:19.769694 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:19.769651    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9969fddd-5eb8-4fd1-9ae9-089741d40478-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:19.769694 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:19.769694    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9969fddd-5eb8-4fd1-9ae9-089741d40478-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:19.770202 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:19.769811    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 21:01:19.770202 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:19.769816    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 21:01:19.770202 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:19.769879    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9969fddd-5eb8-4fd1-9ae9-089741d40478-kube-rbac-proxy-cm podName:9969fddd-5eb8-4fd1-9ae9-089741d40478 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:27.769861387 +0000 UTC m=+285.793899958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9969fddd-5eb8-4fd1-9ae9-089741d40478-kube-rbac-proxy-cm") pod "insights-runtime-extractor-872zt" (UID: "9969fddd-5eb8-4fd1-9ae9-089741d40478") : configmap "kube-rbac-proxy" not found
Jul 22 21:01:19.770202 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:19.769895    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9969fddd-5eb8-4fd1-9ae9-089741d40478-insights-runtime-extractor-tls podName:9969fddd-5eb8-4fd1-9ae9-089741d40478 nodeName:}" failed. No retries permitted until 2026-07-22 21:01:27.769886957 +0000 UTC m=+285.793925514 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9969fddd-5eb8-4fd1-9ae9-089741d40478-insights-runtime-extractor-tls") pod "insights-runtime-extractor-872zt" (UID: "9969fddd-5eb8-4fd1-9ae9-089741d40478") : secret "insights-runtime-extractor-tls" not found
Jul 22 21:01:23.898820 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:23.898761    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6" podUID="7f3af114-071e-4ecb-98b3-c6b7de9ccfde"
Jul 22 21:01:23.898820 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:23.898762    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24" podUID="c0af42d4-27c6-437d-9fdf-06f88118e432"
Jul 22 21:01:23.898820 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:23.898786    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4bw2q" podUID="3c68b0c1-3f71-40fe-b12a-1122487bfec5"
Jul 22 21:01:24.249139 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:24.249043    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 21:01:24.249139 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:24.249070    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4bw2q"
Jul 22 21:01:24.249349 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:24.249296    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24"
Jul 22 21:01:26.922898 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:26.922859    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls\") pod \"dns-default-4bw2q\" (UID: \"3c68b0c1-3f71-40fe-b12a-1122487bfec5\") " pod="openshift-dns/dns-default-4bw2q"
Jul 22 21:01:26.923408 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:26.922922    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 21:01:26.923408 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:26.922947    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5mn24\" (UID: \"c0af42d4-27c6-437d-9fdf-06f88118e432\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24"
Jul 22 21:01:26.925385 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:26.925361    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c68b0c1-3f71-40fe-b12a-1122487bfec5-metrics-tls\") pod \"dns-default-4bw2q\" (UID: \"3c68b0c1-3f71-40fe-b12a-1122487bfec5\") " pod="openshift-dns/dns-default-4bw2q"
Jul 22 21:01:26.925532 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:26.925513    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c0af42d4-27c6-437d-9fdf-06f88118e432-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5mn24\" (UID: \"c0af42d4-27c6-437d-9fdf-06f88118e432\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24"
Jul 22 21:01:26.925570 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:26.925558    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls\") pod \"image-registry-64fff5d94d-gdhz6\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") " pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 21:01:26.953847 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:26.953826    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6fmcx\""
Jul 22 21:01:26.953957 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:26.953859    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9s96p\""
Jul 22 21:01:26.953957 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:26.953912    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b7lth\""
Jul 22 21:01:26.960811 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:26.960798    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24"
Jul 22 21:01:26.960898 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:26.960886    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4bw2q"
Jul 22 21:01:26.960943 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:26.960929    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 21:01:27.108283 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:27.108258    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64fff5d94d-gdhz6"]
Jul 22 21:01:27.111253 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:01:27.111228    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f3af114_071e_4ecb_98b3_c6b7de9ccfde.slice/crio-bc749170de753b19c7f05a2b48cdf7e1333298204c214bf557e3f92e4a1ed9d0 WatchSource:0}: Error finding container bc749170de753b19c7f05a2b48cdf7e1333298204c214bf557e3f92e4a1ed9d0: Status 404 returned error can't find the container with id bc749170de753b19c7f05a2b48cdf7e1333298204c214bf557e3f92e4a1ed9d0
Jul 22 21:01:27.120212 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:27.120189    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4bw2q"]
Jul 22 21:01:27.123150 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:01:27.123124    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c68b0c1_3f71_40fe_b12a_1122487bfec5.slice/crio-dbd19a3dd2555df8569ce7fa38e8ab7a6c8e59c4f9363ba76cb8545ef2caf4c9 WatchSource:0}: Error finding container dbd19a3dd2555df8569ce7fa38e8ab7a6c8e59c4f9363ba76cb8545ef2caf4c9: Status 404 returned error can't find the container with id dbd19a3dd2555df8569ce7fa38e8ab7a6c8e59c4f9363ba76cb8545ef2caf4c9
Jul 22 21:01:27.134200 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:27.134177    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24"]
Jul 22 21:01:27.140087 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:01:27.140067    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0af42d4_27c6_437d_9fdf_06f88118e432.slice/crio-41c1eaf610555ff9d1ba0385fa36db80a2ccea66a94a4329dfda52d6e50e0d7c WatchSource:0}: Error finding container 41c1eaf610555ff9d1ba0385fa36db80a2ccea66a94a4329dfda52d6e50e0d7c: Status 404 returned error can't find the container with id 41c1eaf610555ff9d1ba0385fa36db80a2ccea66a94a4329dfda52d6e50e0d7c
Jul 22 21:01:27.260273 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:27.260201    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6" event={"ID":"7f3af114-071e-4ecb-98b3-c6b7de9ccfde","Type":"ContainerStarted","Data":"f2a02a011285a5d5a886ad5fd945f4a4fdb5ba8c8fb72df85af1db42d8a28e16"}
Jul 22 21:01:27.260273 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:27.260259    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6" event={"ID":"7f3af114-071e-4ecb-98b3-c6b7de9ccfde","Type":"ContainerStarted","Data":"bc749170de753b19c7f05a2b48cdf7e1333298204c214bf557e3f92e4a1ed9d0"}
Jul 22 21:01:27.260447 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:27.260336    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 21:01:27.261334 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:27.261312    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4bw2q" event={"ID":"3c68b0c1-3f71-40fe-b12a-1122487bfec5","Type":"ContainerStarted","Data":"dbd19a3dd2555df8569ce7fa38e8ab7a6c8e59c4f9363ba76cb8545ef2caf4c9"}
Jul 22 21:01:27.262401 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:27.262379    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24" event={"ID":"c0af42d4-27c6-437d-9fdf-06f88118e432","Type":"ContainerStarted","Data":"41c1eaf610555ff9d1ba0385fa36db80a2ccea66a94a4329dfda52d6e50e0d7c"}
Jul 22 21:01:27.282164 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:27.282101    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6" podStartSLOduration=284.282088671 podStartE2EDuration="4m44.282088671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:56:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:01:27.281311885 +0000 UTC m=+285.305350465" watchObservedRunningTime="2026-07-22 21:01:27.282088671 +0000 UTC m=+285.306127249"
Jul 22 21:01:27.829340 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:27.829311    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9969fddd-5eb8-4fd1-9ae9-089741d40478-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:27.829533 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:27.829346    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9969fddd-5eb8-4fd1-9ae9-089741d40478-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:27.829958 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:27.829931    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9969fddd-5eb8-4fd1-9ae9-089741d40478-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:27.832044 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:27.832025    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9969fddd-5eb8-4fd1-9ae9-089741d40478-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-872zt\" (UID: \"9969fddd-5eb8-4fd1-9ae9-089741d40478\") " pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:27.952786 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:27.952752    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-872zt"
Jul 22 21:01:28.105345 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:28.105267    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-872zt"]
Jul 22 21:01:28.109500 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:01:28.109361    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9969fddd_5eb8_4fd1_9ae9_089741d40478.slice/crio-b435616265ee7d3e7281572aafdb9112ee603d87840939a695037e76e05dbdef WatchSource:0}: Error finding container b435616265ee7d3e7281572aafdb9112ee603d87840939a695037e76e05dbdef: Status 404 returned error can't find the container with id b435616265ee7d3e7281572aafdb9112ee603d87840939a695037e76e05dbdef
Jul 22 21:01:28.266888 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:28.266858    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-872zt" event={"ID":"9969fddd-5eb8-4fd1-9ae9-089741d40478","Type":"ContainerStarted","Data":"b435616265ee7d3e7281572aafdb9112ee603d87840939a695037e76e05dbdef"}
Jul 22 21:01:29.271001 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:29.270921    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24" event={"ID":"c0af42d4-27c6-437d-9fdf-06f88118e432","Type":"ContainerStarted","Data":"6b0c1637020ba8c5215624f1546fd62319f9d62cab4debd62cbcb19b535a32ff"}
Jul 22 21:01:29.272761 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:29.272734    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4bw2q" event={"ID":"3c68b0c1-3f71-40fe-b12a-1122487bfec5","Type":"ContainerStarted","Data":"f10977a487deeb56eb16d34a26a6b8d59d75764d621242b0264f89868e0a1c99"}
Jul 22 21:01:29.272858 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:29.272781    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4bw2q" event={"ID":"3c68b0c1-3f71-40fe-b12a-1122487bfec5","Type":"ContainerStarted","Data":"89d2e56a7157a41eea73fa61e79cbbbbd1048179601e7488bc046d0bb6e6b835"}
Jul 22 21:01:29.272896 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:29.272872    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4bw2q"
Jul 22 21:01:29.285702 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:29.285661    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5mn24" podStartSLOduration=261.432618913 podStartE2EDuration="4m23.285648476s" totalImagesPullingTime="1.853029563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:57:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:01:29.284875329 +0000 UTC m=+287.308913912" watchObservedRunningTime="2026-07-22 21:01:29.285648476 +0000 UTC m=+287.309687055"
Jul 22 21:01:29.303500 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:29.303462    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4bw2q" podStartSLOduration=251.428562232 podStartE2EDuration="4m13.30345017s" totalImagesPullingTime="1.874887938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:57:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:01:29.303202894 +0000 UTC m=+287.327241474" watchObservedRunningTime="2026-07-22 21:01:29.30345017 +0000 UTC m=+287.327488749"
Jul 22 21:01:36.299201 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:36.299162    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-872zt" event={"ID":"9969fddd-5eb8-4fd1-9ae9-089741d40478","Type":"ContainerStarted","Data":"292d342347448cbda7cb90334d5a2fe1b35aab25ba85860eb7c631a62ca49e26"}
Jul 22 21:01:39.278026 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:39.278001    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4bw2q"
Jul 22 21:01:39.310712 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:39.310689    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-872zt" event={"ID":"9969fddd-5eb8-4fd1-9ae9-089741d40478","Type":"ContainerStarted","Data":"de7d77ac7ece667af5516d55e80bbe91d0baf946814beaac22d0596afcc25da2"}
Jul 22 21:01:39.404923 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:39.404894    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-f6h54" podUID="e32f596b-8ead-471c-8e23-92b5816c3cd9"
Jul 22 21:01:42.986024 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:42.985995    2583 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 21:01:43.332068 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:43.332001    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-872zt" event={"ID":"9969fddd-5eb8-4fd1-9ae9-089741d40478","Type":"ContainerStarted","Data":"073387e35d5797b15ef47fec1a81e07a55609fd92429aad7a32100b56b89670a"}
Jul 22 21:01:43.351709 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:43.351663    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-872zt" podStartSLOduration=16.564601636 podStartE2EDuration="31.351649914s" totalImagesPullingTime="14.787048278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:01:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:01:43.350720908 +0000 UTC m=+301.374759487" watchObservedRunningTime="2026-07-22 21:01:43.351649914 +0000 UTC m=+301.375688493"
Jul 22 21:01:46.966055 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:46.966006    2583 patch_prober.go:28] interesting pod/image-registry-64fff5d94d-gdhz6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 22 21:01:46.966538 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:46.966080    2583 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6" podUID="7f3af114-071e-4ecb-98b3-c6b7de9ccfde" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 21:01:48.271095 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:48.271064    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 21:01:53.940790 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:53.940752    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fgq9c"]
Jul 22 21:01:53.948700 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:53.948647    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:53.951979 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:53.951950    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 21:01:53.952089 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:53.951950    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 21:01:53.952461 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:53.952441    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 21:01:53.952558 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:53.952497    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 21:01:53.952807 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:53.952790    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 21:01:53.952885 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:53.952871    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8pdzx\""
Jul 22 21:01:53.952932 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:53.952872    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 21:01:54.114084 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.114049    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/06e3409a-e7b4-452b-a0c8-97adec942f68-node-exporter-wtmp\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.114233 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.114102    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/06e3409a-e7b4-452b-a0c8-97adec942f68-node-exporter-accelerators-collector-config\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.114233 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.114170    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fqll\" (UniqueName: \"kubernetes.io/projected/06e3409a-e7b4-452b-a0c8-97adec942f68-kube-api-access-7fqll\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.114233 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.114201    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06e3409a-e7b4-452b-a0c8-97adec942f68-sys\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.114233 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.114222    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/06e3409a-e7b4-452b-a0c8-97adec942f68-root\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.114416 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.114250    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/06e3409a-e7b4-452b-a0c8-97adec942f68-node-exporter-textfile\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.114416 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.114294    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/06e3409a-e7b4-452b-a0c8-97adec942f68-node-exporter-tls\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.114416 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.114339    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06e3409a-e7b4-452b-a0c8-97adec942f68-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.114416 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.114391    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06e3409a-e7b4-452b-a0c8-97adec942f68-metrics-client-ca\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.215473 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.215415    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/06e3409a-e7b4-452b-a0c8-97adec942f68-node-exporter-accelerators-collector-config\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.215473 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.215444    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fqll\" (UniqueName: \"kubernetes.io/projected/06e3409a-e7b4-452b-a0c8-97adec942f68-kube-api-access-7fqll\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.215473 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.215464    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06e3409a-e7b4-452b-a0c8-97adec942f68-sys\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.215680 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.215478    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/06e3409a-e7b4-452b-a0c8-97adec942f68-root\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.215680 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.215496    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/06e3409a-e7b4-452b-a0c8-97adec942f68-node-exporter-textfile\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.215680 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.215522    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/06e3409a-e7b4-452b-a0c8-97adec942f68-node-exporter-tls\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.215680 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.215542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06e3409a-e7b4-452b-a0c8-97adec942f68-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.215680 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.215555    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06e3409a-e7b4-452b-a0c8-97adec942f68-sys\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.215680 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.215559    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/06e3409a-e7b4-452b-a0c8-97adec942f68-root\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.215680 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.215583    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06e3409a-e7b4-452b-a0c8-97adec942f68-metrics-client-ca\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.215680 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.215637    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/06e3409a-e7b4-452b-a0c8-97adec942f68-node-exporter-wtmp\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.216044 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.215754    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/06e3409a-e7b4-452b-a0c8-97adec942f68-node-exporter-wtmp\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.216044 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.215868    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/06e3409a-e7b4-452b-a0c8-97adec942f68-node-exporter-textfile\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.216250 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.216231    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06e3409a-e7b4-452b-a0c8-97adec942f68-metrics-client-ca\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.216347 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.216246    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/06e3409a-e7b4-452b-a0c8-97adec942f68-node-exporter-accelerators-collector-config\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.218074 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.218050    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06e3409a-e7b4-452b-a0c8-97adec942f68-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.218220 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.218203    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/06e3409a-e7b4-452b-a0c8-97adec942f68-node-exporter-tls\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.223973 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.223945    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fqll\" (UniqueName: \"kubernetes.io/projected/06e3409a-e7b4-452b-a0c8-97adec942f68-kube-api-access-7fqll\") pod \"node-exporter-fgq9c\" (UID: \"06e3409a-e7b4-452b-a0c8-97adec942f68\") " pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.258196 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.258174    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fgq9c"
Jul 22 21:01:54.272447 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:01:54.272420    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06e3409a_e7b4_452b_a0c8_97adec942f68.slice/crio-34e1c96dbb773c25f47b0dc4a07c7e11247ac65a7e91557964d30ff36a361548 WatchSource:0}: Error finding container 34e1c96dbb773c25f47b0dc4a07c7e11247ac65a7e91557964d30ff36a361548: Status 404 returned error can't find the container with id 34e1c96dbb773c25f47b0dc4a07c7e11247ac65a7e91557964d30ff36a361548
Jul 22 21:01:54.274433 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.274418    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 21:01:54.368631 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.368603    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fgq9c" event={"ID":"06e3409a-e7b4-452b-a0c8-97adec942f68","Type":"ContainerStarted","Data":"34e1c96dbb773c25f47b0dc4a07c7e11247ac65a7e91557964d30ff36a361548"}
Jul 22 21:01:54.404530 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:54.404508    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 21:01:55.031686 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.031657    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 21:01:55.036744 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.036723    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.039503 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.039480    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 22 21:01:55.039503 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.039492    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 22 21:01:55.039684 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.039512    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 22 21:01:55.039684 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.039661    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-q7g8t\""
Jul 22 21:01:55.039817 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.039795    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 22 21:01:55.039951 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.039875    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 22 21:01:55.039951 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.039915    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 22 21:01:55.040171 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.040010    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 22 21:01:55.040171 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.040020    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 22 21:01:55.040171 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.040041    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 22 21:01:55.050161 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.050138    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 21:01:55.122260 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.122234    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-config-volume\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.122406 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.122270    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.122406 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.122293    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.122406 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.122329    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-web-config\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.122406 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.122352    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.122595 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.122410    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.122595 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.122447    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.122595 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.122499    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-config-out\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.122595 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.122543    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.122595 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.122581    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.122761 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.122622    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkqlp\" (UniqueName: \"kubernetes.io/projected/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-kube-api-access-mkqlp\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.122761 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.122647    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.122761 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.122662    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.223045 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.223019    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-web-config\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.223174 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.223060    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.223174 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.223078    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.223174 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.223103    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.223174 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.223166    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-config-out\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.223460 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.223194    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.223460 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.223224    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.223836 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.223814    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.225018 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.223962    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkqlp\" (UniqueName: \"kubernetes.io/projected/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-kube-api-access-mkqlp\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.225018 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.224019    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.225018 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.224049    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.225018 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.224101    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-config-volume\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.225018 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.224162    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.225018 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.224189    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.225018 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.224488    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.225990 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.225866    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-config-out\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.226076 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:55.225994    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-alertmanager-trusted-ca-bundle podName:5c3cc1d3-a51e-4676-93fa-b3c48f459d2b nodeName:}" failed. No retries permitted until 2026-07-22 21:01:55.725974308 +0000 UTC m=+313.750012868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b") : configmap references non-existent config key: ca-bundle.crt
Jul 22 21:01:55.226076 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.226034    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-web-config\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.226232 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:55.226075    2583 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 22 21:01:55.226232 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:01:55.226156    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-main-tls podName:5c3cc1d3-a51e-4676-93fa-b3c48f459d2b nodeName:}" failed. No retries permitted until 2026-07-22 21:01:55.726101337 +0000 UTC m=+313.750139894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b") : secret "alertmanager-main-tls" not found
Jul 22 21:01:55.226232 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.226192    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.226394 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.226254    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.226522 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.226497    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.226806 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.226663    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.228032 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.228006    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.228558 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.228533    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-config-volume\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.231433 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.231413    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkqlp\" (UniqueName: \"kubernetes.io/projected/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-kube-api-access-mkqlp\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.373351 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.373327    2583 generic.go:356] "Generic (PLEG): container finished" podID="06e3409a-e7b4-452b-a0c8-97adec942f68" containerID="167eed69df5fa5fa07a77122dd33b7a68d85d586a94c9aeb502730917787c285" exitCode=0
Jul 22 21:01:55.373455 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.373369    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fgq9c" event={"ID":"06e3409a-e7b4-452b-a0c8-97adec942f68","Type":"ContainerDied","Data":"167eed69df5fa5fa07a77122dd33b7a68d85d586a94c9aeb502730917787c285"}
Jul 22 21:01:55.728195 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.728158    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.728348 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.728222    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.728877 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.728854    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.730647 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.730623    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:55.948002 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:55.947973    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:01:56.089056 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:56.089025    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 21:01:56.089793 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:01:56.089754    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c3cc1d3_a51e_4676_93fa_b3c48f459d2b.slice/crio-a4bc06309255119becf1697e2d85d8418527c49044e29167fb1ed0e245a4b9f2 WatchSource:0}: Error finding container a4bc06309255119becf1697e2d85d8418527c49044e29167fb1ed0e245a4b9f2: Status 404 returned error can't find the container with id a4bc06309255119becf1697e2d85d8418527c49044e29167fb1ed0e245a4b9f2
Jul 22 21:01:56.132126 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:56.132083    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64fff5d94d-gdhz6"]
Jul 22 21:01:56.379736 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:56.379707    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fgq9c" event={"ID":"06e3409a-e7b4-452b-a0c8-97adec942f68","Type":"ContainerStarted","Data":"379d83c228924cb96f6c7d8d0ff2023034295b763f52ba08225fb273f38bc7bc"}
Jul 22 21:01:56.379878 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:56.379751    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fgq9c" event={"ID":"06e3409a-e7b4-452b-a0c8-97adec942f68","Type":"ContainerStarted","Data":"6f6c2b315779974f082cfd9d7bd2474d4698d0cba4fa6801d4589a03649643f3"}
Jul 22 21:01:56.380774 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:56.380747    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b","Type":"ContainerStarted","Data":"a4bc06309255119becf1697e2d85d8418527c49044e29167fb1ed0e245a4b9f2"}
Jul 22 21:01:56.397546 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:56.397503    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fgq9c" podStartSLOduration=2.426029793 podStartE2EDuration="3.397489148s" totalImagesPullingTime="901.912513ms" totalInitContainerRuntime="69.546842ms" isStatefulPod=true podCreationTimestamp="2026-07-22 21:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:01:56.396682647 +0000 UTC m=+314.420721230" watchObservedRunningTime="2026-07-22 21:01:56.397489148 +0000 UTC m=+314.421527727"
Jul 22 21:01:57.386025 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:57.385996    2583 generic.go:356] "Generic (PLEG): container finished" podID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerID="c623a22aaa0b63514135614a473f2ab033cde9e8a7634dc545eb78bdaa24d51c" exitCode=0
Jul 22 21:01:57.386407 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:57.386078    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b","Type":"ContainerDied","Data":"c623a22aaa0b63514135614a473f2ab033cde9e8a7634dc545eb78bdaa24d51c"}
Jul 22 21:01:59.169915 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.169884    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-868bdd678-9dxmf"]
Jul 22 21:01:59.184592 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.184570    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.187905 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.187714    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 22 21:01:59.187905 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.187763    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 22 21:01:59.187905 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.187763    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 22 21:01:59.188625 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.188420    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 22 21:01:59.188775 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.188756    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 22 21:01:59.189285 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.188991    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2pjps\""
Jul 22 21:01:59.190151 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.190132    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-868bdd678-9dxmf"]
Jul 22 21:01:59.204059 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.204035    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 22 21:01:59.355900 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.355876    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76fa3d85-1682-4f5e-baf1-fa5f45a3e791-serving-certs-ca-bundle\") pod \"telemeter-client-868bdd678-9dxmf\" (UID: \"76fa3d85-1682-4f5e-baf1-fa5f45a3e791\") " pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.356034 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.355912    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/76fa3d85-1682-4f5e-baf1-fa5f45a3e791-telemeter-client-tls\") pod \"telemeter-client-868bdd678-9dxmf\" (UID: \"76fa3d85-1682-4f5e-baf1-fa5f45a3e791\") " pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.356034 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.355940    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76fa3d85-1682-4f5e-baf1-fa5f45a3e791-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-868bdd678-9dxmf\" (UID: \"76fa3d85-1682-4f5e-baf1-fa5f45a3e791\") " pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.356176 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.356126    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76fa3d85-1682-4f5e-baf1-fa5f45a3e791-telemeter-trusted-ca-bundle\") pod \"telemeter-client-868bdd678-9dxmf\" (UID: \"76fa3d85-1682-4f5e-baf1-fa5f45a3e791\") " pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.356269 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.356174    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/76fa3d85-1682-4f5e-baf1-fa5f45a3e791-federate-client-tls\") pod \"telemeter-client-868bdd678-9dxmf\" (UID: \"76fa3d85-1682-4f5e-baf1-fa5f45a3e791\") " pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.356269 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.356223    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gktvv\" (UniqueName: \"kubernetes.io/projected/76fa3d85-1682-4f5e-baf1-fa5f45a3e791-kube-api-access-gktvv\") pod \"telemeter-client-868bdd678-9dxmf\" (UID: \"76fa3d85-1682-4f5e-baf1-fa5f45a3e791\") " pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.356348 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.356330    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/76fa3d85-1682-4f5e-baf1-fa5f45a3e791-secret-telemeter-client\") pod \"telemeter-client-868bdd678-9dxmf\" (UID: \"76fa3d85-1682-4f5e-baf1-fa5f45a3e791\") " pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.356384 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.356360    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76fa3d85-1682-4f5e-baf1-fa5f45a3e791-metrics-client-ca\") pod \"telemeter-client-868bdd678-9dxmf\" (UID: \"76fa3d85-1682-4f5e-baf1-fa5f45a3e791\") " pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.394798 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.394772    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b","Type":"ContainerStarted","Data":"f6bdd67da7f1f2e20b65c1b1f23daa212815caf02d33f548662a12c5ea20f53a"}
Jul 22 21:01:59.457135 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.457069    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/76fa3d85-1682-4f5e-baf1-fa5f45a3e791-federate-client-tls\") pod \"telemeter-client-868bdd678-9dxmf\" (UID: \"76fa3d85-1682-4f5e-baf1-fa5f45a3e791\") " pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.457135 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.457100    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gktvv\" (UniqueName: \"kubernetes.io/projected/76fa3d85-1682-4f5e-baf1-fa5f45a3e791-kube-api-access-gktvv\") pod \"telemeter-client-868bdd678-9dxmf\" (UID: \"76fa3d85-1682-4f5e-baf1-fa5f45a3e791\") " pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.457283 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.457163    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/76fa3d85-1682-4f5e-baf1-fa5f45a3e791-secret-telemeter-client\") pod \"telemeter-client-868bdd678-9dxmf\" (UID: \"76fa3d85-1682-4f5e-baf1-fa5f45a3e791\") " pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.457283 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.457182    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76fa3d85-1682-4f5e-baf1-fa5f45a3e791-metrics-client-ca\") pod \"telemeter-client-868bdd678-9dxmf\" (UID: \"76fa3d85-1682-4f5e-baf1-fa5f45a3e791\") " pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.457283 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.457209    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76fa3d85-1682-4f5e-baf1-fa5f45a3e791-serving-certs-ca-bundle\") pod \"telemeter-client-868bdd678-9dxmf\" (UID: \"76fa3d85-1682-4f5e-baf1-fa5f45a3e791\") " pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.457283 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.457234    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/76fa3d85-1682-4f5e-baf1-fa5f45a3e791-telemeter-client-tls\") pod \"telemeter-client-868bdd678-9dxmf\" (UID: \"76fa3d85-1682-4f5e-baf1-fa5f45a3e791\") " pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.457283 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.457259    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76fa3d85-1682-4f5e-baf1-fa5f45a3e791-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-868bdd678-9dxmf\" (UID: \"76fa3d85-1682-4f5e-baf1-fa5f45a3e791\") " pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.457523 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.457394    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76fa3d85-1682-4f5e-baf1-fa5f45a3e791-telemeter-trusted-ca-bundle\") pod \"telemeter-client-868bdd678-9dxmf\" (UID: \"76fa3d85-1682-4f5e-baf1-fa5f45a3e791\") " pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.458201 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.458086    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76fa3d85-1682-4f5e-baf1-fa5f45a3e791-metrics-client-ca\") pod \"telemeter-client-868bdd678-9dxmf\" (UID: \"76fa3d85-1682-4f5e-baf1-fa5f45a3e791\") " pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.458301 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.458204    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76fa3d85-1682-4f5e-baf1-fa5f45a3e791-telemeter-trusted-ca-bundle\") pod \"telemeter-client-868bdd678-9dxmf\" (UID: \"76fa3d85-1682-4f5e-baf1-fa5f45a3e791\") " pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.458301 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.458241    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76fa3d85-1682-4f5e-baf1-fa5f45a3e791-serving-certs-ca-bundle\") pod \"telemeter-client-868bdd678-9dxmf\" (UID: \"76fa3d85-1682-4f5e-baf1-fa5f45a3e791\") " pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.459442 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.459423    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/76fa3d85-1682-4f5e-baf1-fa5f45a3e791-federate-client-tls\") pod \"telemeter-client-868bdd678-9dxmf\" (UID: \"76fa3d85-1682-4f5e-baf1-fa5f45a3e791\") " pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.459755 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.459735    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/76fa3d85-1682-4f5e-baf1-fa5f45a3e791-telemeter-client-tls\") pod \"telemeter-client-868bdd678-9dxmf\" (UID: \"76fa3d85-1682-4f5e-baf1-fa5f45a3e791\") " pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.460103 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.460086    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/76fa3d85-1682-4f5e-baf1-fa5f45a3e791-secret-telemeter-client\") pod \"telemeter-client-868bdd678-9dxmf\" (UID: \"76fa3d85-1682-4f5e-baf1-fa5f45a3e791\") " pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.460167 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.460142    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76fa3d85-1682-4f5e-baf1-fa5f45a3e791-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-868bdd678-9dxmf\" (UID: \"76fa3d85-1682-4f5e-baf1-fa5f45a3e791\") " pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.465537 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.465516    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gktvv\" (UniqueName: \"kubernetes.io/projected/76fa3d85-1682-4f5e-baf1-fa5f45a3e791-kube-api-access-gktvv\") pod \"telemeter-client-868bdd678-9dxmf\" (UID: \"76fa3d85-1682-4f5e-baf1-fa5f45a3e791\") " pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.495996 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.495979    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf"
Jul 22 21:01:59.648634 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:01:59.648613    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-868bdd678-9dxmf"]
Jul 22 21:01:59.650430 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:01:59.650404    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76fa3d85_1682_4f5e_baf1_fa5f45a3e791.slice/crio-01e6a2b44eb377578ffa53edf707aee18dfda943ae6b9433bad69b7fe485fba8 WatchSource:0}: Error finding container 01e6a2b44eb377578ffa53edf707aee18dfda943ae6b9433bad69b7fe485fba8: Status 404 returned error can't find the container with id 01e6a2b44eb377578ffa53edf707aee18dfda943ae6b9433bad69b7fe485fba8
Jul 22 21:02:00.216388 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.216363    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 21:02:00.246849 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.246819    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 21:02:00.246978 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.246945    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.249688 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.249662    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 21:02:00.249818 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.249662    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 21:02:00.249818 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.249667    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 21:02:00.249818 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.249715    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 21:02:00.249952 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.249924    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 21:02:00.250074 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.250059    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 21:02:00.250174 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.250158    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 21:02:00.250242 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.250225    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 21:02:00.250384 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.250301    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 21:02:00.250384 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.250363    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 21:02:00.250518 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.250406    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 21:02:00.250518 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.250415    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-n2gng\""
Jul 22 21:02:00.250829 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.250814    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 21:02:00.250906 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.250890    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-69o5sd8mjhji1\""
Jul 22 21:02:00.250946 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.250932    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 21:02:00.250984 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.250889    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 21:02:00.252651 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.252633    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 21:02:00.366033 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.366004    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ff7b2178-3dd0-4058-abb9-fc8057f1079a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.366211 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.366054    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-config\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.366211 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.366079    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d48s\" (UniqueName: \"kubernetes.io/projected/ff7b2178-3dd0-4058-abb9-fc8057f1079a-kube-api-access-9d48s\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.366211 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.366148    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.366211 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.366173    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.366211 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.366199    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.366426 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.366289    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.366426 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.366330    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.366426 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.366362    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.366426 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.366386    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.366426 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.366425    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.366650 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.366517    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.366650 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.366546    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.366650 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.366574    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.366650 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.366590    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.366650 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.366609    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ff7b2178-3dd0-4058-abb9-fc8057f1079a-config-out\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.366650 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.366631    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-web-config\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.366925 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.366660    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.366925 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.366678    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.366925 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.366703    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.400799 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.400774    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b","Type":"ContainerStarted","Data":"f09eecfebe4e237919b0b1cd421052089e8906f5b9da3b235c4816b0a8c7d1a1"}
Jul 22 21:02:00.400914 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.400847    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b","Type":"ContainerStarted","Data":"6266ec912363d1bf288154ce69ff10d4ebfc8a2cf42a97f55a3db19e6c795b92"}
Jul 22 21:02:00.400914 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.400889    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b","Type":"ContainerStarted","Data":"0247a0443fc57358c9dd0bd4a42fa8279bda8fcc392ec30ace12daa26c6e0c4c"}
Jul 22 21:02:00.400998 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.400928    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b","Type":"ContainerStarted","Data":"b43f8253e2b50ac47487d56ca3c2a438e1c484db7070db02303ab2097bdc3140"}
Jul 22 21:02:00.401973 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.401944    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf" event={"ID":"76fa3d85-1682-4f5e-baf1-fa5f45a3e791","Type":"ContainerStarted","Data":"01e6a2b44eb377578ffa53edf707aee18dfda943ae6b9433bad69b7fe485fba8"}
Jul 22 21:02:00.467398 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.467343    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.467398 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.467381    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.467559 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.467404    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ff7b2178-3dd0-4058-abb9-fc8057f1079a-config-out\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.467559 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.467428    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-web-config\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.467559 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.467459    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.467559 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.467481    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.467559 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.467516    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.467559 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.467543    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ff7b2178-3dd0-4058-abb9-fc8057f1079a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.467838 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.467574    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-config\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.467838 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.467596    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d48s\" (UniqueName: \"kubernetes.io/projected/ff7b2178-3dd0-4058-abb9-fc8057f1079a-kube-api-access-9d48s\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.467838 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.467638    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.467838 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.467665    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.467838 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.467693    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.467838 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.467743    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.467838 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.467774    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.467838 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.467802    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.468386 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.467853    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.468386 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.467908    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.468386 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.467946    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.468386 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.467969    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.468946 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.468835    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.469351 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.469329    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.469543 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.469518    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.470244 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.470218    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.470339 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.470315    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.471121 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.471049    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ff7b2178-3dd0-4058-abb9-fc8057f1079a-config-out\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.471620 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.471595    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.472048 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.472001    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ff7b2178-3dd0-4058-abb9-fc8057f1079a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.472293 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.472259    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.472637 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.472602    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-config\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.472850 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.472828    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.473662 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.473623    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.474152 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.474132    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.474424 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.474367    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.474683 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.474634    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.475163 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.475093    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.475273 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.475253    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-web-config\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.475396 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.475267    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.476710 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.476688    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.477722 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.477689    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d48s\" (UniqueName: \"kubernetes.io/projected/ff7b2178-3dd0-4058-abb9-fc8057f1079a-kube-api-access-9d48s\") pod \"prometheus-k8s-0\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.557273 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.557250    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:00.737789 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:00.737706    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 21:02:00.740726 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:02:00.740689    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff7b2178_3dd0_4058_abb9_fc8057f1079a.slice/crio-221beed8ab0a132594dda17dae2e1d52d731a0b955b8919237c74544ee4bceb1 WatchSource:0}: Error finding container 221beed8ab0a132594dda17dae2e1d52d731a0b955b8919237c74544ee4bceb1: Status 404 returned error can't find the container with id 221beed8ab0a132594dda17dae2e1d52d731a0b955b8919237c74544ee4bceb1
Jul 22 21:02:01.410228 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:01.410193    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b","Type":"ContainerStarted","Data":"a15e01cedaa80b2c773ef53cce5d3b767bc067a211d25340562844e8641b64ba"}
Jul 22 21:02:01.412049 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:01.412017    2583 generic.go:356] "Generic (PLEG): container finished" podID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerID="01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27" exitCode=0
Jul 22 21:02:01.412186 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:01.412075    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff7b2178-3dd0-4058-abb9-fc8057f1079a","Type":"ContainerDied","Data":"01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27"}
Jul 22 21:02:01.412186 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:01.412148    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff7b2178-3dd0-4058-abb9-fc8057f1079a","Type":"ContainerStarted","Data":"221beed8ab0a132594dda17dae2e1d52d731a0b955b8919237c74544ee4bceb1"}
Jul 22 21:02:01.437906 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:01.437857    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.073862028 podStartE2EDuration="6.437841385s" totalImagesPullingTime="4.343753123s" totalInitContainerRuntime="20.226234ms" isStatefulPod=false podCreationTimestamp="2026-07-22 21:01:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:02:01.436623677 +0000 UTC m=+319.460662255" watchObservedRunningTime="2026-07-22 21:02:01.437841385 +0000 UTC m=+319.461879964"
Jul 22 21:02:02.419254 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:02.419204    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf" event={"ID":"76fa3d85-1682-4f5e-baf1-fa5f45a3e791","Type":"ContainerStarted","Data":"f0344fb7e760cb7ce66910aca4cfb648919a9189cf076e19b9451877d99c6a60"}
Jul 22 21:02:02.419602 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:02.419277    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf" event={"ID":"76fa3d85-1682-4f5e-baf1-fa5f45a3e791","Type":"ContainerStarted","Data":"846b49ce4a03d3f0682f0860a568423390da428599be8b21c5ccb478ff0163aa"}
Jul 22 21:02:03.426271 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:03.426230    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf" event={"ID":"76fa3d85-1682-4f5e-baf1-fa5f45a3e791","Type":"ContainerStarted","Data":"ad0a642e612deec2c538869ac1cfaadc8f5d912197ff8d25de12e34ade8fb2ef"}
Jul 22 21:02:03.459696 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:03.459650    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-868bdd678-9dxmf" podStartSLOduration=1.97512286 podStartE2EDuration="4.459635373s" totalImagesPullingTime="2.484512513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:01:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:02:03.454607903 +0000 UTC m=+321.478646495" watchObservedRunningTime="2026-07-22 21:02:03.459635373 +0000 UTC m=+321.483673952"
Jul 22 21:02:05.056701 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:05.056659    2583 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw" podUID="e5603dbd-75ff-45cf-9588-9a5bb64c334b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 22 21:02:05.437179 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:05.437138    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff7b2178-3dd0-4058-abb9-fc8057f1079a","Type":"ContainerStarted","Data":"74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a"}
Jul 22 21:02:05.437288 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:05.437221    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff7b2178-3dd0-4058-abb9-fc8057f1079a","Type":"ContainerStarted","Data":"a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3"}
Jul 22 21:02:07.447439 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:07.447410    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff7b2178-3dd0-4058-abb9-fc8057f1079a","Type":"ContainerStarted","Data":"5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993"}
Jul 22 21:02:07.447774 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:07.447493    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff7b2178-3dd0-4058-abb9-fc8057f1079a","Type":"ContainerStarted","Data":"a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c"}
Jul 22 21:02:07.447774 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:07.447519    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff7b2178-3dd0-4058-abb9-fc8057f1079a","Type":"ContainerStarted","Data":"f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714"}
Jul 22 21:02:07.447774 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:07.447546    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff7b2178-3dd0-4058-abb9-fc8057f1079a","Type":"ContainerStarted","Data":"66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb"}
Jul 22 21:02:07.491966 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:07.491920    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.9211238750000001 podStartE2EDuration="7.491901615s" totalImagesPullingTime="5.531909632s" totalInitContainerRuntime="38.868108ms" isStatefulPod=false podCreationTimestamp="2026-07-22 21:02:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:02:07.490795239 +0000 UTC m=+325.514833818" watchObservedRunningTime="2026-07-22 21:02:07.491901615 +0000 UTC m=+325.515940195"
Jul 22 21:02:10.558031 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:10.557997    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:02:15.055562 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:15.055519    2583 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw" podUID="e5603dbd-75ff-45cf-9588-9a5bb64c334b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 22 21:02:21.151952 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.151887    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6" podUID="7f3af114-071e-4ecb-98b3-c6b7de9ccfde" containerName="registry" containerID="cri-o://f2a02a011285a5d5a886ad5fd945f4a4fdb5ba8c8fb72df85af1db42d8a28e16" gracePeriod=30
Jul 22 21:02:21.398210 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.398189    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 21:02:21.434592 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.434534    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-bound-sa-token\") pod \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") "
Jul 22 21:02:21.434592 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.434579    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-image-registry-private-configuration\") pod \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") "
Jul 22 21:02:21.434747 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.434619    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-certificates\") pod \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") "
Jul 22 21:02:21.434747 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.434677    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9kn6\" (UniqueName: \"kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-kube-api-access-t9kn6\") pod \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") "
Jul 22 21:02:21.434747 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.434725    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-trusted-ca\") pod \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") "
Jul 22 21:02:21.434893 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.434756    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-ca-trust-extracted\") pod \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") "
Jul 22 21:02:21.434893 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.434785    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-installation-pull-secrets\") pod \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") "
Jul 22 21:02:21.434893 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.434817    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls\") pod \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\" (UID: \"7f3af114-071e-4ecb-98b3-c6b7de9ccfde\") "
Jul 22 21:02:21.435561 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.435093    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7f3af114-071e-4ecb-98b3-c6b7de9ccfde" (UID: "7f3af114-071e-4ecb-98b3-c6b7de9ccfde"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:02:21.435681 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.435657    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7f3af114-071e-4ecb-98b3-c6b7de9ccfde" (UID: "7f3af114-071e-4ecb-98b3-c6b7de9ccfde"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:02:21.437481 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.437438    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7f3af114-071e-4ecb-98b3-c6b7de9ccfde" (UID: "7f3af114-071e-4ecb-98b3-c6b7de9ccfde"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:02:21.437666 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.437632    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7f3af114-071e-4ecb-98b3-c6b7de9ccfde" (UID: "7f3af114-071e-4ecb-98b3-c6b7de9ccfde"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:02:21.437912 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.437887    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7f3af114-071e-4ecb-98b3-c6b7de9ccfde" (UID: "7f3af114-071e-4ecb-98b3-c6b7de9ccfde"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:02:21.438005 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.437904    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-kube-api-access-t9kn6" (OuterVolumeSpecName: "kube-api-access-t9kn6") pod "7f3af114-071e-4ecb-98b3-c6b7de9ccfde" (UID: "7f3af114-071e-4ecb-98b3-c6b7de9ccfde"). InnerVolumeSpecName "kube-api-access-t9kn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:02:21.438197 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.438167    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7f3af114-071e-4ecb-98b3-c6b7de9ccfde" (UID: "7f3af114-071e-4ecb-98b3-c6b7de9ccfde"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:02:21.444341 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.444318    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7f3af114-071e-4ecb-98b3-c6b7de9ccfde" (UID: "7f3af114-071e-4ecb-98b3-c6b7de9ccfde"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:02:21.499533 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.499502    2583 generic.go:356] "Generic (PLEG): container finished" podID="7f3af114-071e-4ecb-98b3-c6b7de9ccfde" containerID="f2a02a011285a5d5a886ad5fd945f4a4fdb5ba8c8fb72df85af1db42d8a28e16" exitCode=0
Jul 22 21:02:21.499668 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.499552    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6"
Jul 22 21:02:21.499668 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.499586    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6" event={"ID":"7f3af114-071e-4ecb-98b3-c6b7de9ccfde","Type":"ContainerDied","Data":"f2a02a011285a5d5a886ad5fd945f4a4fdb5ba8c8fb72df85af1db42d8a28e16"}
Jul 22 21:02:21.499668 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.499632    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64fff5d94d-gdhz6" event={"ID":"7f3af114-071e-4ecb-98b3-c6b7de9ccfde","Type":"ContainerDied","Data":"bc749170de753b19c7f05a2b48cdf7e1333298204c214bf557e3f92e4a1ed9d0"}
Jul 22 21:02:21.499668 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.499653    2583 scope.go:117] "RemoveContainer" containerID="f2a02a011285a5d5a886ad5fd945f4a4fdb5ba8c8fb72df85af1db42d8a28e16"
Jul 22 21:02:21.508972 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.508952    2583 scope.go:117] "RemoveContainer" containerID="f2a02a011285a5d5a886ad5fd945f4a4fdb5ba8c8fb72df85af1db42d8a28e16"
Jul 22 21:02:21.509249 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:02:21.509229    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2a02a011285a5d5a886ad5fd945f4a4fdb5ba8c8fb72df85af1db42d8a28e16\": container with ID starting with f2a02a011285a5d5a886ad5fd945f4a4fdb5ba8c8fb72df85af1db42d8a28e16 not found: ID does not exist" containerID="f2a02a011285a5d5a886ad5fd945f4a4fdb5ba8c8fb72df85af1db42d8a28e16"
Jul 22 21:02:21.509308 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.509258    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2a02a011285a5d5a886ad5fd945f4a4fdb5ba8c8fb72df85af1db42d8a28e16"} err="failed to get container status \"f2a02a011285a5d5a886ad5fd945f4a4fdb5ba8c8fb72df85af1db42d8a28e16\": rpc error: code = NotFound desc = could not find container \"f2a02a011285a5d5a886ad5fd945f4a4fdb5ba8c8fb72df85af1db42d8a28e16\": container with ID starting with f2a02a011285a5d5a886ad5fd945f4a4fdb5ba8c8fb72df85af1db42d8a28e16 not found: ID does not exist"
Jul 22 21:02:21.521512 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.521458    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64fff5d94d-gdhz6"]
Jul 22 21:02:21.522974 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.522955    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64fff5d94d-gdhz6"]
Jul 22 21:02:21.535533 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.535512    2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-bound-sa-token\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:02:21.535533 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.535535    2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-image-registry-private-configuration\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:02:21.535658 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.535545    2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-certificates\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:02:21.535658 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.535553    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9kn6\" (UniqueName: \"kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-kube-api-access-t9kn6\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:02:21.535658 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.535562    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-trusted-ca\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:02:21.535658 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.535569    2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-ca-trust-extracted\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:02:21.535658 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.535578    2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-installation-pull-secrets\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:02:21.535658 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:21.535587    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f3af114-071e-4ecb-98b3-c6b7de9ccfde-registry-tls\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:02:22.411199 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:22.411148    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f3af114-071e-4ecb-98b3-c6b7de9ccfde" path="/var/lib/kubelet/pods/7f3af114-071e-4ecb-98b3-c6b7de9ccfde/volumes"
Jul 22 21:02:22.641678 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:22.641651    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j2zwd_06dcf1b9-ea23-4842-8fcc-a5e8295407df/serve-healthcheck-canary/0.log"
Jul 22 21:02:25.055393 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:25.055354    2583 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw" podUID="e5603dbd-75ff-45cf-9588-9a5bb64c334b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 22 21:02:25.055758 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:25.055418    2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw"
Jul 22 21:02:25.055896 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:25.055878    2583 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"870277205c7320a3596f3be66af0971e8aa7d35d4cc3e5a9107b08433cafcd49"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 22 21:02:25.055931 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:25.055918    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw" podUID="e5603dbd-75ff-45cf-9588-9a5bb64c334b" containerName="service-proxy" containerID="cri-o://870277205c7320a3596f3be66af0971e8aa7d35d4cc3e5a9107b08433cafcd49" gracePeriod=30
Jul 22 21:02:25.517549 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:25.517519    2583 generic.go:356] "Generic (PLEG): container finished" podID="e5603dbd-75ff-45cf-9588-9a5bb64c334b" containerID="870277205c7320a3596f3be66af0971e8aa7d35d4cc3e5a9107b08433cafcd49" exitCode=2
Jul 22 21:02:25.517690 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:25.517582    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw" event={"ID":"e5603dbd-75ff-45cf-9588-9a5bb64c334b","Type":"ContainerDied","Data":"870277205c7320a3596f3be66af0971e8aa7d35d4cc3e5a9107b08433cafcd49"}
Jul 22 21:02:25.517690 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:25.517615    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8675f786c4-69nfw" event={"ID":"e5603dbd-75ff-45cf-9588-9a5bb64c334b","Type":"ContainerStarted","Data":"8d460d5b48594bc51e78eef1e27bc377d634369957fd8e95bf52eadebae309c0"}
Jul 22 21:02:56.286754 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:56.286711    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs\") pod \"network-metrics-daemon-f6h54\" (UID: \"e32f596b-8ead-471c-8e23-92b5816c3cd9\") " pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 21:02:56.289481 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:56.289455    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e32f596b-8ead-471c-8e23-92b5816c3cd9-metrics-certs\") pod \"network-metrics-daemon-f6h54\" (UID: \"e32f596b-8ead-471c-8e23-92b5816c3cd9\") " pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 21:02:56.508279 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:56.508250    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j26qm\""
Jul 22 21:02:56.516068 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:56.516046    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6h54"
Jul 22 21:02:56.650865 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:56.650833    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f6h54"]
Jul 22 21:02:56.654634 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:02:56.654611    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode32f596b_8ead_471c_8e23_92b5816c3cd9.slice/crio-1e87911a3a70df5504f0edb6a7bf6a1acb1a4d2656f772a91c3aba89338dfbe7 WatchSource:0}: Error finding container 1e87911a3a70df5504f0edb6a7bf6a1acb1a4d2656f772a91c3aba89338dfbe7: Status 404 returned error can't find the container with id 1e87911a3a70df5504f0edb6a7bf6a1acb1a4d2656f772a91c3aba89338dfbe7
Jul 22 21:02:57.637249 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:57.637214    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f6h54" event={"ID":"e32f596b-8ead-471c-8e23-92b5816c3cd9","Type":"ContainerStarted","Data":"1e87911a3a70df5504f0edb6a7bf6a1acb1a4d2656f772a91c3aba89338dfbe7"}
Jul 22 21:02:58.643068 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:58.643019    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f6h54" event={"ID":"e32f596b-8ead-471c-8e23-92b5816c3cd9","Type":"ContainerStarted","Data":"19d08858f1ae54861207f6765546e33e4d71558c21b7857ebd7c9d938c004e02"}
Jul 22 21:02:58.643514 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:58.643093    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f6h54" event={"ID":"e32f596b-8ead-471c-8e23-92b5816c3cd9","Type":"ContainerStarted","Data":"42f2e790502346956e4427896cce794d934b413e6272a2a302a1bf11e3da97ba"}
Jul 22 21:02:58.665250 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:02:58.665197    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-f6h54" podStartSLOduration=375.550538514 podStartE2EDuration="6m16.665179793s" totalImagesPullingTime="1.114641279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:56:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:02:58.664891135 +0000 UTC m=+376.688929714" watchObservedRunningTime="2026-07-22 21:02:58.665179793 +0000 UTC m=+376.689218435"
Jul 22 21:03:00.558153 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:00.558099    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:00.576890 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:00.576866    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:00.665343 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:00.665317    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:14.386871 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:14.386838    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 21:03:14.387380 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:14.387143    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="alertmanager" containerID="cri-o://f6bdd67da7f1f2e20b65c1b1f23daa212815caf02d33f548662a12c5ea20f53a" gracePeriod=120
Jul 22 21:03:14.387380 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:14.387192    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="kube-rbac-proxy-metric" containerID="cri-o://f09eecfebe4e237919b0b1cd421052089e8906f5b9da3b235c4816b0a8c7d1a1" gracePeriod=120
Jul 22 21:03:14.387380 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:14.387255    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="kube-rbac-proxy" containerID="cri-o://6266ec912363d1bf288154ce69ff10d4ebfc8a2cf42a97f55a3db19e6c795b92" gracePeriod=120
Jul 22 21:03:14.387380 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:14.387258    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="config-reloader" containerID="cri-o://b43f8253e2b50ac47487d56ca3c2a438e1c484db7070db02303ab2097bdc3140" gracePeriod=120
Jul 22 21:03:14.387380 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:14.387216    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="kube-rbac-proxy-web" containerID="cri-o://0247a0443fc57358c9dd0bd4a42fa8279bda8fcc392ec30ace12daa26c6e0c4c" gracePeriod=120
Jul 22 21:03:14.387380 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:14.387285    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="prom-label-proxy" containerID="cri-o://a15e01cedaa80b2c773ef53cce5d3b767bc067a211d25340562844e8641b64ba" gracePeriod=120
Jul 22 21:03:14.705785 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:14.705711    2583 generic.go:356] "Generic (PLEG): container finished" podID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerID="a15e01cedaa80b2c773ef53cce5d3b767bc067a211d25340562844e8641b64ba" exitCode=0
Jul 22 21:03:14.705785 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:14.705736    2583 generic.go:356] "Generic (PLEG): container finished" podID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerID="f09eecfebe4e237919b0b1cd421052089e8906f5b9da3b235c4816b0a8c7d1a1" exitCode=0
Jul 22 21:03:14.705785 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:14.705752    2583 generic.go:356] "Generic (PLEG): container finished" podID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerID="6266ec912363d1bf288154ce69ff10d4ebfc8a2cf42a97f55a3db19e6c795b92" exitCode=0
Jul 22 21:03:14.705785 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:14.705762    2583 generic.go:356] "Generic (PLEG): container finished" podID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerID="b43f8253e2b50ac47487d56ca3c2a438e1c484db7070db02303ab2097bdc3140" exitCode=0
Jul 22 21:03:14.705785 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:14.705770    2583 generic.go:356] "Generic (PLEG): container finished" podID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerID="f6bdd67da7f1f2e20b65c1b1f23daa212815caf02d33f548662a12c5ea20f53a" exitCode=0
Jul 22 21:03:14.706009 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:14.705785    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b","Type":"ContainerDied","Data":"a15e01cedaa80b2c773ef53cce5d3b767bc067a211d25340562844e8641b64ba"}
Jul 22 21:03:14.706009 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:14.705848    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b","Type":"ContainerDied","Data":"f09eecfebe4e237919b0b1cd421052089e8906f5b9da3b235c4816b0a8c7d1a1"}
Jul 22 21:03:14.706009 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:14.705874    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b","Type":"ContainerDied","Data":"6266ec912363d1bf288154ce69ff10d4ebfc8a2cf42a97f55a3db19e6c795b92"}
Jul 22 21:03:14.706009 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:14.705899    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b","Type":"ContainerDied","Data":"b43f8253e2b50ac47487d56ca3c2a438e1c484db7070db02303ab2097bdc3140"}
Jul 22 21:03:14.706009 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:14.705923    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b","Type":"ContainerDied","Data":"f6bdd67da7f1f2e20b65c1b1f23daa212815caf02d33f548662a12c5ea20f53a"}
Jul 22 21:03:15.628034 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.628013    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:15.712828 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.712801    2583 generic.go:356] "Generic (PLEG): container finished" podID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerID="0247a0443fc57358c9dd0bd4a42fa8279bda8fcc392ec30ace12daa26c6e0c4c" exitCode=0
Jul 22 21:03:15.712957 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.712889    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:15.713005 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.712879    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b","Type":"ContainerDied","Data":"0247a0443fc57358c9dd0bd4a42fa8279bda8fcc392ec30ace12daa26c6e0c4c"}
Jul 22 21:03:15.713051 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.713038    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b","Type":"ContainerDied","Data":"a4bc06309255119becf1697e2d85d8418527c49044e29167fb1ed0e245a4b9f2"}
Jul 22 21:03:15.713103 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.713091    2583 scope.go:117] "RemoveContainer" containerID="a15e01cedaa80b2c773ef53cce5d3b767bc067a211d25340562844e8641b64ba"
Jul 22 21:03:15.720031 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.720007    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-tls-assets\") pod \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") "
Jul 22 21:03:15.720174 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.720036    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-kube-rbac-proxy-web\") pod \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") "
Jul 22 21:03:15.720174 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.720120    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-web-config\") pod \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") "
Jul 22 21:03:15.720174 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.720156    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-main-tls\") pod \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") "
Jul 22 21:03:15.720344 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.720184    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-cluster-tls-config\") pod \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") "
Jul 22 21:03:15.720344 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.720214    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") "
Jul 22 21:03:15.720344 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.720273    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-metrics-client-ca\") pod \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") "
Jul 22 21:03:15.720344 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.720314    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-config-volume\") pod \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") "
Jul 22 21:03:15.720344 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.720338    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-kube-rbac-proxy\") pod \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") "
Jul 22 21:03:15.720681 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.720370    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-config-out\") pod \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") "
Jul 22 21:03:15.720681 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.720397    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-alertmanager-main-db\") pod \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") "
Jul 22 21:03:15.720681 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.720446    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-alertmanager-trusted-ca-bundle\") pod \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") "
Jul 22 21:03:15.720681 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.720494    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkqlp\" (UniqueName: \"kubernetes.io/projected/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-kube-api-access-mkqlp\") pod \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\" (UID: \"5c3cc1d3-a51e-4676-93fa-b3c48f459d2b\") "
Jul 22 21:03:15.720681 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.720604    2583 scope.go:117] "RemoveContainer" containerID="f09eecfebe4e237919b0b1cd421052089e8906f5b9da3b235c4816b0a8c7d1a1"
Jul 22 21:03:15.721503 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.721180    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" (UID: "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:03:15.721766 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.721604    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" (UID: "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:03:15.721766 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.721618    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" (UID: "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:03:15.723863 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.723826    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" (UID: "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:03:15.724051 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.724017    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" (UID: "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:03:15.724259 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.724214    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" (UID: "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:03:15.724259 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.724225    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" (UID: "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:03:15.724259 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.724248    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-kube-api-access-mkqlp" (OuterVolumeSpecName: "kube-api-access-mkqlp") pod "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" (UID: "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b"). InnerVolumeSpecName "kube-api-access-mkqlp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:03:15.724767 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.724742    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-config-volume" (OuterVolumeSpecName: "config-volume") pod "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" (UID: "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:03:15.725734 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.725671    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" (UID: "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:03:15.725989 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.725969    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-config-out" (OuterVolumeSpecName: "config-out") pod "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" (UID: "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:03:15.728515 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.728496    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" (UID: "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:03:15.734269 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.734247    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-web-config" (OuterVolumeSpecName: "web-config") pod "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" (UID: "5c3cc1d3-a51e-4676-93fa-b3c48f459d2b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:03:15.741055 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.741038    2583 scope.go:117] "RemoveContainer" containerID="6266ec912363d1bf288154ce69ff10d4ebfc8a2cf42a97f55a3db19e6c795b92"
Jul 22 21:03:15.747463 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.747445    2583 scope.go:117] "RemoveContainer" containerID="0247a0443fc57358c9dd0bd4a42fa8279bda8fcc392ec30ace12daa26c6e0c4c"
Jul 22 21:03:15.753514 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.753496    2583 scope.go:117] "RemoveContainer" containerID="b43f8253e2b50ac47487d56ca3c2a438e1c484db7070db02303ab2097bdc3140"
Jul 22 21:03:15.759835 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.759820    2583 scope.go:117] "RemoveContainer" containerID="f6bdd67da7f1f2e20b65c1b1f23daa212815caf02d33f548662a12c5ea20f53a"
Jul 22 21:03:15.766345 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.766333    2583 scope.go:117] "RemoveContainer" containerID="c623a22aaa0b63514135614a473f2ab033cde9e8a7634dc545eb78bdaa24d51c"
Jul 22 21:03:15.772640 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.772625    2583 scope.go:117] "RemoveContainer" containerID="a15e01cedaa80b2c773ef53cce5d3b767bc067a211d25340562844e8641b64ba"
Jul 22 21:03:15.772870 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:03:15.772852    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a15e01cedaa80b2c773ef53cce5d3b767bc067a211d25340562844e8641b64ba\": container with ID starting with a15e01cedaa80b2c773ef53cce5d3b767bc067a211d25340562844e8641b64ba not found: ID does not exist" containerID="a15e01cedaa80b2c773ef53cce5d3b767bc067a211d25340562844e8641b64ba"
Jul 22 21:03:15.772937 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.772880    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a15e01cedaa80b2c773ef53cce5d3b767bc067a211d25340562844e8641b64ba"} err="failed to get container status \"a15e01cedaa80b2c773ef53cce5d3b767bc067a211d25340562844e8641b64ba\": rpc error: code = NotFound desc = could not find container \"a15e01cedaa80b2c773ef53cce5d3b767bc067a211d25340562844e8641b64ba\": container with ID starting with a15e01cedaa80b2c773ef53cce5d3b767bc067a211d25340562844e8641b64ba not found: ID does not exist"
Jul 22 21:03:15.772937 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.772897    2583 scope.go:117] "RemoveContainer" containerID="f09eecfebe4e237919b0b1cd421052089e8906f5b9da3b235c4816b0a8c7d1a1"
Jul 22 21:03:15.773157 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:03:15.773140    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f09eecfebe4e237919b0b1cd421052089e8906f5b9da3b235c4816b0a8c7d1a1\": container with ID starting with f09eecfebe4e237919b0b1cd421052089e8906f5b9da3b235c4816b0a8c7d1a1 not found: ID does not exist" containerID="f09eecfebe4e237919b0b1cd421052089e8906f5b9da3b235c4816b0a8c7d1a1"
Jul 22 21:03:15.773198 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.773162    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f09eecfebe4e237919b0b1cd421052089e8906f5b9da3b235c4816b0a8c7d1a1"} err="failed to get container status \"f09eecfebe4e237919b0b1cd421052089e8906f5b9da3b235c4816b0a8c7d1a1\": rpc error: code = NotFound desc = could not find container \"f09eecfebe4e237919b0b1cd421052089e8906f5b9da3b235c4816b0a8c7d1a1\": container with ID starting with f09eecfebe4e237919b0b1cd421052089e8906f5b9da3b235c4816b0a8c7d1a1 not found: ID does not exist"
Jul 22 21:03:15.773198 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.773175    2583 scope.go:117] "RemoveContainer" containerID="6266ec912363d1bf288154ce69ff10d4ebfc8a2cf42a97f55a3db19e6c795b92"
Jul 22 21:03:15.773391 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:03:15.773373    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6266ec912363d1bf288154ce69ff10d4ebfc8a2cf42a97f55a3db19e6c795b92\": container with ID starting with 6266ec912363d1bf288154ce69ff10d4ebfc8a2cf42a97f55a3db19e6c795b92 not found: ID does not exist" containerID="6266ec912363d1bf288154ce69ff10d4ebfc8a2cf42a97f55a3db19e6c795b92"
Jul 22 21:03:15.773434 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.773395    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6266ec912363d1bf288154ce69ff10d4ebfc8a2cf42a97f55a3db19e6c795b92"} err="failed to get container status \"6266ec912363d1bf288154ce69ff10d4ebfc8a2cf42a97f55a3db19e6c795b92\": rpc error: code = NotFound desc = could not find container \"6266ec912363d1bf288154ce69ff10d4ebfc8a2cf42a97f55a3db19e6c795b92\": container with ID starting with 6266ec912363d1bf288154ce69ff10d4ebfc8a2cf42a97f55a3db19e6c795b92 not found: ID does not exist"
Jul 22 21:03:15.773434 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.773408    2583 scope.go:117] "RemoveContainer" containerID="0247a0443fc57358c9dd0bd4a42fa8279bda8fcc392ec30ace12daa26c6e0c4c"
Jul 22 21:03:15.773678 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:03:15.773664    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0247a0443fc57358c9dd0bd4a42fa8279bda8fcc392ec30ace12daa26c6e0c4c\": container with ID starting with 0247a0443fc57358c9dd0bd4a42fa8279bda8fcc392ec30ace12daa26c6e0c4c not found: ID does not exist" containerID="0247a0443fc57358c9dd0bd4a42fa8279bda8fcc392ec30ace12daa26c6e0c4c"
Jul 22 21:03:15.773724 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.773681    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0247a0443fc57358c9dd0bd4a42fa8279bda8fcc392ec30ace12daa26c6e0c4c"} err="failed to get container status \"0247a0443fc57358c9dd0bd4a42fa8279bda8fcc392ec30ace12daa26c6e0c4c\": rpc error: code = NotFound desc = could not find container \"0247a0443fc57358c9dd0bd4a42fa8279bda8fcc392ec30ace12daa26c6e0c4c\": container with ID starting with 0247a0443fc57358c9dd0bd4a42fa8279bda8fcc392ec30ace12daa26c6e0c4c not found: ID does not exist"
Jul 22 21:03:15.773724 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.773692    2583 scope.go:117] "RemoveContainer" containerID="b43f8253e2b50ac47487d56ca3c2a438e1c484db7070db02303ab2097bdc3140"
Jul 22 21:03:15.773937 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:03:15.773921    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b43f8253e2b50ac47487d56ca3c2a438e1c484db7070db02303ab2097bdc3140\": container with ID starting with b43f8253e2b50ac47487d56ca3c2a438e1c484db7070db02303ab2097bdc3140 not found: ID does not exist" containerID="b43f8253e2b50ac47487d56ca3c2a438e1c484db7070db02303ab2097bdc3140"
Jul 22 21:03:15.773977 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.773941    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b43f8253e2b50ac47487d56ca3c2a438e1c484db7070db02303ab2097bdc3140"} err="failed to get container status \"b43f8253e2b50ac47487d56ca3c2a438e1c484db7070db02303ab2097bdc3140\": rpc error: code = NotFound desc = could not find container \"b43f8253e2b50ac47487d56ca3c2a438e1c484db7070db02303ab2097bdc3140\": container with ID starting with b43f8253e2b50ac47487d56ca3c2a438e1c484db7070db02303ab2097bdc3140 not found: ID does not exist"
Jul 22 21:03:15.773977 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.773954    2583 scope.go:117] "RemoveContainer" containerID="f6bdd67da7f1f2e20b65c1b1f23daa212815caf02d33f548662a12c5ea20f53a"
Jul 22 21:03:15.774168 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:03:15.774151    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6bdd67da7f1f2e20b65c1b1f23daa212815caf02d33f548662a12c5ea20f53a\": container with ID starting with f6bdd67da7f1f2e20b65c1b1f23daa212815caf02d33f548662a12c5ea20f53a not found: ID does not exist" containerID="f6bdd67da7f1f2e20b65c1b1f23daa212815caf02d33f548662a12c5ea20f53a"
Jul 22 21:03:15.774213 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.774174    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6bdd67da7f1f2e20b65c1b1f23daa212815caf02d33f548662a12c5ea20f53a"} err="failed to get container status \"f6bdd67da7f1f2e20b65c1b1f23daa212815caf02d33f548662a12c5ea20f53a\": rpc error: code = NotFound desc = could not find container \"f6bdd67da7f1f2e20b65c1b1f23daa212815caf02d33f548662a12c5ea20f53a\": container with ID starting with f6bdd67da7f1f2e20b65c1b1f23daa212815caf02d33f548662a12c5ea20f53a not found: ID does not exist"
Jul 22 21:03:15.774213 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.774188    2583 scope.go:117] "RemoveContainer" containerID="c623a22aaa0b63514135614a473f2ab033cde9e8a7634dc545eb78bdaa24d51c"
Jul 22 21:03:15.774445 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:03:15.774428    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c623a22aaa0b63514135614a473f2ab033cde9e8a7634dc545eb78bdaa24d51c\": container with ID starting with c623a22aaa0b63514135614a473f2ab033cde9e8a7634dc545eb78bdaa24d51c not found: ID does not exist" containerID="c623a22aaa0b63514135614a473f2ab033cde9e8a7634dc545eb78bdaa24d51c"
Jul 22 21:03:15.774489 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.774449    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c623a22aaa0b63514135614a473f2ab033cde9e8a7634dc545eb78bdaa24d51c"} err="failed to get container status \"c623a22aaa0b63514135614a473f2ab033cde9e8a7634dc545eb78bdaa24d51c\": rpc error: code = NotFound desc = could not find container \"c623a22aaa0b63514135614a473f2ab033cde9e8a7634dc545eb78bdaa24d51c\": container with ID starting with c623a22aaa0b63514135614a473f2ab033cde9e8a7634dc545eb78bdaa24d51c not found: ID does not exist"
Jul 22 21:03:15.821941 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.821920    2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-web-config\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:15.821941 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.821940    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-main-tls\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:15.822063 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.821949    2583 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-cluster-tls-config\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:15.822063 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.821961    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:15.822063 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.821970    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-metrics-client-ca\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:15.822063 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.821979    2583 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-config-volume\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:15.822063 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.821987    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:15.822063 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.821995    2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-config-out\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:15.822063 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.822004    2583 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-alertmanager-main-db\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:15.822063 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.822013    2583 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:15.822063 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.822020    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkqlp\" (UniqueName: \"kubernetes.io/projected/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-kube-api-access-mkqlp\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:15.822063 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.822028    2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-tls-assets\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:15.822063 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:15.822036    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:16.037926 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.037898    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 21:03:16.041548 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.041528    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 21:03:16.075427 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.075389    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 21:03:16.075621 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.075610    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f3af114-071e-4ecb-98b3-c6b7de9ccfde" containerName="registry"
Jul 22 21:03:16.075670 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.075624    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f3af114-071e-4ecb-98b3-c6b7de9ccfde" containerName="registry"
Jul 22 21:03:16.075670 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.075632    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="prom-label-proxy"
Jul 22 21:03:16.075670 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.075638    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="prom-label-proxy"
Jul 22 21:03:16.075670 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.075645    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="alertmanager"
Jul 22 21:03:16.075670 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.075650    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="alertmanager"
Jul 22 21:03:16.075670 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.075658    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="config-reloader"
Jul 22 21:03:16.075670 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.075665    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="config-reloader"
Jul 22 21:03:16.075865 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.075675    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="kube-rbac-proxy"
Jul 22 21:03:16.075865 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.075680    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="kube-rbac-proxy"
Jul 22 21:03:16.075865 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.075688    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="init-config-reloader"
Jul 22 21:03:16.075865 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.075693    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="init-config-reloader"
Jul 22 21:03:16.075865 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.075702    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="kube-rbac-proxy-web"
Jul 22 21:03:16.075865 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.075706    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="kube-rbac-proxy-web"
Jul 22 21:03:16.075865 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.075713    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="kube-rbac-proxy-metric"
Jul 22 21:03:16.075865 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.075718    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="kube-rbac-proxy-metric"
Jul 22 21:03:16.075865 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.075755    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f3af114-071e-4ecb-98b3-c6b7de9ccfde" containerName="registry"
Jul 22 21:03:16.075865 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.075761    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="config-reloader"
Jul 22 21:03:16.075865 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.075766    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="kube-rbac-proxy-web"
Jul 22 21:03:16.075865 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.075772    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="alertmanager"
Jul 22 21:03:16.075865 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.075776    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="prom-label-proxy"
Jul 22 21:03:16.075865 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.075782    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="kube-rbac-proxy"
Jul 22 21:03:16.075865 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.075786    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" containerName="kube-rbac-proxy-metric"
Jul 22 21:03:16.082813 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.082792    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.086825 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.086808    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 22 21:03:16.087122 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.087091    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 22 21:03:16.087163 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.087091    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 22 21:03:16.087370 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.087352    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 22 21:03:16.092417 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.092389    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 22 21:03:16.092627 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.092609    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-q7g8t\""
Jul 22 21:03:16.093183 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.093168    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 22 21:03:16.093263 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.093195    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 22 21:03:16.093468 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.093451    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 22 21:03:16.100542 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.100522    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 22 21:03:16.106073 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.106057    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 21:03:16.226053 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.226029    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46c69bc0-1847-4417-99a7-dc8401fd003f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.226173 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.226061    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46c69bc0-1847-4417-99a7-dc8401fd003f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.226173 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.226080    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/46c69bc0-1847-4417-99a7-dc8401fd003f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.226173 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.226099    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/46c69bc0-1847-4417-99a7-dc8401fd003f-web-config\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.226276 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.226231    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/46c69bc0-1847-4417-99a7-dc8401fd003f-config-volume\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.226276 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.226263    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/46c69bc0-1847-4417-99a7-dc8401fd003f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.226341 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.226281    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wphs6\" (UniqueName: \"kubernetes.io/projected/46c69bc0-1847-4417-99a7-dc8401fd003f-kube-api-access-wphs6\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.226341 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.226299    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/46c69bc0-1847-4417-99a7-dc8401fd003f-config-out\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.226341 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.226322    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/46c69bc0-1847-4417-99a7-dc8401fd003f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.226465 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.226385    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/46c69bc0-1847-4417-99a7-dc8401fd003f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.226465 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.226457    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/46c69bc0-1847-4417-99a7-dc8401fd003f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.226564 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.226483    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/46c69bc0-1847-4417-99a7-dc8401fd003f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.226564 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.226529    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/46c69bc0-1847-4417-99a7-dc8401fd003f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.327653 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.327584    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46c69bc0-1847-4417-99a7-dc8401fd003f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.327653 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.327626    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46c69bc0-1847-4417-99a7-dc8401fd003f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.327653 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.327649    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/46c69bc0-1847-4417-99a7-dc8401fd003f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.327853 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.327671    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/46c69bc0-1847-4417-99a7-dc8401fd003f-web-config\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.327853 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.327694    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/46c69bc0-1847-4417-99a7-dc8401fd003f-config-volume\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.327853 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.327712    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/46c69bc0-1847-4417-99a7-dc8401fd003f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.327853 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.327730    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wphs6\" (UniqueName: \"kubernetes.io/projected/46c69bc0-1847-4417-99a7-dc8401fd003f-kube-api-access-wphs6\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.327853 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.327774    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/46c69bc0-1847-4417-99a7-dc8401fd003f-config-out\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.327853 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.327799    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/46c69bc0-1847-4417-99a7-dc8401fd003f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.327853 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.327834    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/46c69bc0-1847-4417-99a7-dc8401fd003f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.328200 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.327866    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/46c69bc0-1847-4417-99a7-dc8401fd003f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.328200 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.327897    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/46c69bc0-1847-4417-99a7-dc8401fd003f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.328200 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.327920    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/46c69bc0-1847-4417-99a7-dc8401fd003f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.328357 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.328246    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/46c69bc0-1847-4417-99a7-dc8401fd003f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.328558 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.328534    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46c69bc0-1847-4417-99a7-dc8401fd003f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.329651 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.329618    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46c69bc0-1847-4417-99a7-dc8401fd003f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.331528 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.331437    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/46c69bc0-1847-4417-99a7-dc8401fd003f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.331528 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.331451    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/46c69bc0-1847-4417-99a7-dc8401fd003f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.331705 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.331540    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/46c69bc0-1847-4417-99a7-dc8401fd003f-web-config\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.331705 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.331599    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/46c69bc0-1847-4417-99a7-dc8401fd003f-config-volume\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.331705 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.331625    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/46c69bc0-1847-4417-99a7-dc8401fd003f-config-out\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.331867 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.331857    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/46c69bc0-1847-4417-99a7-dc8401fd003f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.332092 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.332063    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/46c69bc0-1847-4417-99a7-dc8401fd003f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.332711 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.332682    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/46c69bc0-1847-4417-99a7-dc8401fd003f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.333942 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.333918    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/46c69bc0-1847-4417-99a7-dc8401fd003f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.336836 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.336817    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wphs6\" (UniqueName: \"kubernetes.io/projected/46c69bc0-1847-4417-99a7-dc8401fd003f-kube-api-access-wphs6\") pod \"alertmanager-main-0\" (UID: \"46c69bc0-1847-4417-99a7-dc8401fd003f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.391837 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.391811    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 21:03:16.408541 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.408518    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c3cc1d3-a51e-4676-93fa-b3c48f459d2b" path="/var/lib/kubelet/pods/5c3cc1d3-a51e-4676-93fa-b3c48f459d2b/volumes"
Jul 22 21:03:16.531292 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.531269    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 21:03:16.532809 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:03:16.532779    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46c69bc0_1847_4417_99a7_dc8401fd003f.slice/crio-6d7c8b3bbe35ef00106c9660c0809d60e0da60f6ba31e21e9c3c9b55ab061d4d WatchSource:0}: Error finding container 6d7c8b3bbe35ef00106c9660c0809d60e0da60f6ba31e21e9c3c9b55ab061d4d: Status 404 returned error can't find the container with id 6d7c8b3bbe35ef00106c9660c0809d60e0da60f6ba31e21e9c3c9b55ab061d4d
Jul 22 21:03:16.718303 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.718271    2583 generic.go:356] "Generic (PLEG): container finished" podID="46c69bc0-1847-4417-99a7-dc8401fd003f" containerID="abc70f86ad5cd2e6fb8150d5c07aa9a5aed88620bf222455843d144b65132dd0" exitCode=0
Jul 22 21:03:16.718570 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.718335    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"46c69bc0-1847-4417-99a7-dc8401fd003f","Type":"ContainerDied","Data":"abc70f86ad5cd2e6fb8150d5c07aa9a5aed88620bf222455843d144b65132dd0"}
Jul 22 21:03:16.718570 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:16.718397    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"46c69bc0-1847-4417-99a7-dc8401fd003f","Type":"ContainerStarted","Data":"6d7c8b3bbe35ef00106c9660c0809d60e0da60f6ba31e21e9c3c9b55ab061d4d"}
Jul 22 21:03:17.726210 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:17.726174    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"46c69bc0-1847-4417-99a7-dc8401fd003f","Type":"ContainerStarted","Data":"9f12c573d0795cb0810cc19979816e7489e39ff756165f2aad52d2dece97709e"}
Jul 22 21:03:17.726589 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:17.726246    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"46c69bc0-1847-4417-99a7-dc8401fd003f","Type":"ContainerStarted","Data":"7f9cbed8c06e5a3dffb978f0b56a3d72ad6f6d5a276652fbb6c3fd9584b18118"}
Jul 22 21:03:17.726589 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:17.726280    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"46c69bc0-1847-4417-99a7-dc8401fd003f","Type":"ContainerStarted","Data":"17ecee6fb471d513edfad01878aa67810ef3b65faf0558706276b73e499fcd3f"}
Jul 22 21:03:17.726589 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:17.726304    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"46c69bc0-1847-4417-99a7-dc8401fd003f","Type":"ContainerStarted","Data":"5425cdc80d6953f44e1612a97bc80628b2b3f72cd1ee0081f903a2d0306cfeb0"}
Jul 22 21:03:17.726589 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:17.726326    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"46c69bc0-1847-4417-99a7-dc8401fd003f","Type":"ContainerStarted","Data":"aa99b109b78108890bf858ebb1d2df19ab70af12f136d31b61d563f35e788d3c"}
Jul 22 21:03:17.726589 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:17.726350    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"46c69bc0-1847-4417-99a7-dc8401fd003f","Type":"ContainerStarted","Data":"ede08d9eb45da82d07a525d232566aa8c4b38efde113b472709aad204cb657ec"}
Jul 22 21:03:17.766719 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:17.766618    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.746531158 podStartE2EDuration="1.766600344s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.069186ms" isStatefulPod=false podCreationTimestamp="2026-07-22 21:03:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:03:17.76610447 +0000 UTC m=+395.790143052" watchObservedRunningTime="2026-07-22 21:03:17.766600344 +0000 UTC m=+395.790638924"
Jul 22 21:03:18.687887 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:18.687857    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 21:03:18.688198 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:18.688164    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="prometheus" containerID="cri-o://a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3" gracePeriod=600
Jul 22 21:03:18.688351 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:18.688191    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="kube-rbac-proxy" containerID="cri-o://a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c" gracePeriod=600
Jul 22 21:03:18.688351 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:18.688207    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="thanos-sidecar" containerID="cri-o://66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb" gracePeriod=600
Jul 22 21:03:18.688351 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:18.688226    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="config-reloader" containerID="cri-o://74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a" gracePeriod=600
Jul 22 21:03:18.688351 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:18.688255    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993" gracePeriod=600
Jul 22 21:03:18.688351 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:18.688231    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="kube-rbac-proxy-web" containerID="cri-o://f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714" gracePeriod=600
Jul 22 21:03:18.934811 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:18.934783    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:19.048929 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.048895    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-configmap-metrics-client-ca\") pod \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") "
Jul 22 21:03:19.048929 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.048932    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-grpc-tls\") pod \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") "
Jul 22 21:03:19.049200 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.048953    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-prometheus-k8s-tls\") pod \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") "
Jul 22 21:03:19.049200 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.048971    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-configmap-serving-certs-ca-bundle\") pod \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") "
Jul 22 21:03:19.049200 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.049002    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-thanos-prometheus-http-client-file\") pod \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") "
Jul 22 21:03:19.049200 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.049044    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-config\") pod \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") "
Jul 22 21:03:19.049200 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.049067    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") "
Jul 22 21:03:19.049200 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.049129    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9d48s\" (UniqueName: \"kubernetes.io/projected/ff7b2178-3dd0-4058-abb9-fc8057f1079a-kube-api-access-9d48s\") pod \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") "
Jul 22 21:03:19.049200 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.049153    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-trusted-ca-bundle\") pod \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") "
Jul 22 21:03:19.049200 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.049174    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-k8s-db\") pod \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") "
Jul 22 21:03:19.049576 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.049212    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ff7b2178-3dd0-4058-abb9-fc8057f1079a-tls-assets\") pod \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") "
Jul 22 21:03:19.049576 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.049238    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") "
Jul 22 21:03:19.049576 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.049279    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-k8s-rulefiles-0\") pod \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") "
Jul 22 21:03:19.049576 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.049314    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-metrics-client-certs\") pod \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") "
Jul 22 21:03:19.049576 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.049339    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-k8s-rulefiles-2\") pod \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") "
Jul 22 21:03:19.049576 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.049363    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ff7b2178-3dd0-4058-abb9-fc8057f1079a-config-out\") pod \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") "
Jul 22 21:03:19.049576 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.049392    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-kube-rbac-proxy\") pod \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") "
Jul 22 21:03:19.049576 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.049395    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ff7b2178-3dd0-4058-abb9-fc8057f1079a" (UID: "ff7b2178-3dd0-4058-abb9-fc8057f1079a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:03:19.049576 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.049424    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-k8s-rulefiles-1\") pod \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") "
Jul 22 21:03:19.049576 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.049446    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ff7b2178-3dd0-4058-abb9-fc8057f1079a" (UID: "ff7b2178-3dd0-4058-abb9-fc8057f1079a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:03:19.049576 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.049455    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-configmap-kubelet-serving-ca-bundle\") pod \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") "
Jul 22 21:03:19.049576 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.049480    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-web-config\") pod \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\" (UID: \"ff7b2178-3dd0-4058-abb9-fc8057f1079a\") "
Jul 22 21:03:19.050325 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.049701    2583 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-configmap-metrics-client-ca\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:19.050325 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.049717    2583 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:19.050325 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.049904    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ff7b2178-3dd0-4058-abb9-fc8057f1079a" (UID: "ff7b2178-3dd0-4058-abb9-fc8057f1079a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:03:19.051091 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.051058    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ff7b2178-3dd0-4058-abb9-fc8057f1079a" (UID: "ff7b2178-3dd0-4058-abb9-fc8057f1079a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:03:19.053086 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.051642    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ff7b2178-3dd0-4058-abb9-fc8057f1079a" (UID: "ff7b2178-3dd0-4058-abb9-fc8057f1079a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:03:19.053086 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.051731    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ff7b2178-3dd0-4058-abb9-fc8057f1079a" (UID: "ff7b2178-3dd0-4058-abb9-fc8057f1079a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:03:19.053086 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.052009    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-config" (OuterVolumeSpecName: "config") pod "ff7b2178-3dd0-4058-abb9-fc8057f1079a" (UID: "ff7b2178-3dd0-4058-abb9-fc8057f1079a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:03:19.053086 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.052028    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ff7b2178-3dd0-4058-abb9-fc8057f1079a" (UID: "ff7b2178-3dd0-4058-abb9-fc8057f1079a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:03:19.053086 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.052654    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ff7b2178-3dd0-4058-abb9-fc8057f1079a" (UID: "ff7b2178-3dd0-4058-abb9-fc8057f1079a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:03:19.053086 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.052677    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ff7b2178-3dd0-4058-abb9-fc8057f1079a" (UID: "ff7b2178-3dd0-4058-abb9-fc8057f1079a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:03:19.053086 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.052971    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ff7b2178-3dd0-4058-abb9-fc8057f1079a" (UID: "ff7b2178-3dd0-4058-abb9-fc8057f1079a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:03:19.053621 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.053206    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ff7b2178-3dd0-4058-abb9-fc8057f1079a" (UID: "ff7b2178-3dd0-4058-abb9-fc8057f1079a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:03:19.053621 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.053559    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ff7b2178-3dd0-4058-abb9-fc8057f1079a" (UID: "ff7b2178-3dd0-4058-abb9-fc8057f1079a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:03:19.053841 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.053809    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ff7b2178-3dd0-4058-abb9-fc8057f1079a" (UID: "ff7b2178-3dd0-4058-abb9-fc8057f1079a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:03:19.053941 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.053845    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ff7b2178-3dd0-4058-abb9-fc8057f1079a" (UID: "ff7b2178-3dd0-4058-abb9-fc8057f1079a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:03:19.053941 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.053867    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ff7b2178-3dd0-4058-abb9-fc8057f1079a" (UID: "ff7b2178-3dd0-4058-abb9-fc8057f1079a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:03:19.054318 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.054297    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff7b2178-3dd0-4058-abb9-fc8057f1079a-kube-api-access-9d48s" (OuterVolumeSpecName: "kube-api-access-9d48s") pod "ff7b2178-3dd0-4058-abb9-fc8057f1079a" (UID: "ff7b2178-3dd0-4058-abb9-fc8057f1079a"). InnerVolumeSpecName "kube-api-access-9d48s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:03:19.054632 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.054614    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff7b2178-3dd0-4058-abb9-fc8057f1079a-config-out" (OuterVolumeSpecName: "config-out") pod "ff7b2178-3dd0-4058-abb9-fc8057f1079a" (UID: "ff7b2178-3dd0-4058-abb9-fc8057f1079a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:03:19.055355 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.055326    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff7b2178-3dd0-4058-abb9-fc8057f1079a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ff7b2178-3dd0-4058-abb9-fc8057f1079a" (UID: "ff7b2178-3dd0-4058-abb9-fc8057f1079a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:03:19.062535 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.062512    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-web-config" (OuterVolumeSpecName: "web-config") pod "ff7b2178-3dd0-4058-abb9-fc8057f1079a" (UID: "ff7b2178-3dd0-4058-abb9-fc8057f1079a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:03:19.150917 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.150892    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:19.150917 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.150915    2583 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-metrics-client-certs\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:19.151044 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.150924    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:19.151044 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.150933    2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ff7b2178-3dd0-4058-abb9-fc8057f1079a-config-out\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:19.151044 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.150942    2583 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-kube-rbac-proxy\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:19.151044 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.150951    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:19.151044 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.150959    2583 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:19.151044 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.150970    2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-web-config\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:19.151044 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.150978    2583 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-grpc-tls\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:19.151044 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.150985    2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:19.151044 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.150993    2583 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:19.151044 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.151001    2583 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-config\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:19.151044 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.151009    2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:19.151044 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.151017    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9d48s\" (UniqueName: \"kubernetes.io/projected/ff7b2178-3dd0-4058-abb9-fc8057f1079a-kube-api-access-9d48s\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:19.151044 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.151025    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:19.151044 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.151032    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ff7b2178-3dd0-4058-abb9-fc8057f1079a-prometheus-k8s-db\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:19.151044 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.151040    2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ff7b2178-3dd0-4058-abb9-fc8057f1079a-tls-assets\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:19.151044 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.151047    2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff7b2178-3dd0-4058-abb9-fc8057f1079a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:03:19.736578 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.736539    2583 generic.go:356] "Generic (PLEG): container finished" podID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerID="5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993" exitCode=0
Jul 22 21:03:19.736578 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.736569    2583 generic.go:356] "Generic (PLEG): container finished" podID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerID="a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c" exitCode=0
Jul 22 21:03:19.736578 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.736578    2583 generic.go:356] "Generic (PLEG): container finished" podID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerID="f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714" exitCode=0
Jul 22 21:03:19.736850 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.736590    2583 generic.go:356] "Generic (PLEG): container finished" podID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerID="66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb" exitCode=0
Jul 22 21:03:19.736850 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.736598    2583 generic.go:356] "Generic (PLEG): container finished" podID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerID="74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a" exitCode=0
Jul 22 21:03:19.736850 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.736606    2583 generic.go:356] "Generic (PLEG): container finished" podID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerID="a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3" exitCode=0
Jul 22 21:03:19.736850 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.736612    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff7b2178-3dd0-4058-abb9-fc8057f1079a","Type":"ContainerDied","Data":"5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993"}
Jul 22 21:03:19.736850 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.736636    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:19.736850 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.736681    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff7b2178-3dd0-4058-abb9-fc8057f1079a","Type":"ContainerDied","Data":"a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c"}
Jul 22 21:03:19.736850 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.736709    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff7b2178-3dd0-4058-abb9-fc8057f1079a","Type":"ContainerDied","Data":"f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714"}
Jul 22 21:03:19.736850 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.736752    2583 scope.go:117] "RemoveContainer" containerID="5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993"
Jul 22 21:03:19.736850 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.736774    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff7b2178-3dd0-4058-abb9-fc8057f1079a","Type":"ContainerDied","Data":"66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb"}
Jul 22 21:03:19.736850 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.736800    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff7b2178-3dd0-4058-abb9-fc8057f1079a","Type":"ContainerDied","Data":"74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a"}
Jul 22 21:03:19.736850 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.736825    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff7b2178-3dd0-4058-abb9-fc8057f1079a","Type":"ContainerDied","Data":"a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3"}
Jul 22 21:03:19.736850 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.736848    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff7b2178-3dd0-4058-abb9-fc8057f1079a","Type":"ContainerDied","Data":"221beed8ab0a132594dda17dae2e1d52d731a0b955b8919237c74544ee4bceb1"}
Jul 22 21:03:19.744614 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.744593    2583 scope.go:117] "RemoveContainer" containerID="a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c"
Jul 22 21:03:19.751710 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.751693    2583 scope.go:117] "RemoveContainer" containerID="f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714"
Jul 22 21:03:19.758381 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.758364    2583 scope.go:117] "RemoveContainer" containerID="66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb"
Jul 22 21:03:19.761175 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.761142    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 21:03:19.766148 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.766129    2583 scope.go:117] "RemoveContainer" containerID="74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a"
Jul 22 21:03:19.766302 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.766280    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 21:03:19.772906 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.772883    2583 scope.go:117] "RemoveContainer" containerID="a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3"
Jul 22 21:03:19.779906 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.779890    2583 scope.go:117] "RemoveContainer" containerID="01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27"
Jul 22 21:03:19.786605 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.786590    2583 scope.go:117] "RemoveContainer" containerID="5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993"
Jul 22 21:03:19.786841 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:03:19.786821    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993\": container with ID starting with 5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993 not found: ID does not exist" containerID="5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993"
Jul 22 21:03:19.786885 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.786848    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993"} err="failed to get container status \"5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993\": rpc error: code = NotFound desc = could not find container \"5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993\": container with ID starting with 5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993 not found: ID does not exist"
Jul 22 21:03:19.786885 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.786865    2583 scope.go:117] "RemoveContainer" containerID="a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c"
Jul 22 21:03:19.787102 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:03:19.787083    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c\": container with ID starting with a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c not found: ID does not exist" containerID="a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c"
Jul 22 21:03:19.787165 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.787134    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c"} err="failed to get container status \"a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c\": rpc error: code = NotFound desc = could not find container \"a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c\": container with ID starting with a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c not found: ID does not exist"
Jul 22 21:03:19.787165 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.787153    2583 scope.go:117] "RemoveContainer" containerID="f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714"
Jul 22 21:03:19.787397 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:03:19.787381    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714\": container with ID starting with f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714 not found: ID does not exist" containerID="f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714"
Jul 22 21:03:19.787449 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.787400    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714"} err="failed to get container status \"f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714\": rpc error: code = NotFound desc = could not find container \"f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714\": container with ID starting with f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714 not found: ID does not exist"
Jul 22 21:03:19.787449 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.787413    2583 scope.go:117] "RemoveContainer" containerID="66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb"
Jul 22 21:03:19.787646 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:03:19.787628    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb\": container with ID starting with 66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb not found: ID does not exist" containerID="66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb"
Jul 22 21:03:19.787689 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.787657    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb"} err="failed to get container status \"66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb\": rpc error: code = NotFound desc = could not find container \"66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb\": container with ID starting with 66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb not found: ID does not exist"
Jul 22 21:03:19.787689 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.787679    2583 scope.go:117] "RemoveContainer" containerID="74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a"
Jul 22 21:03:19.787906 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:03:19.787890    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a\": container with ID starting with 74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a not found: ID does not exist" containerID="74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a"
Jul 22 21:03:19.787956 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.787911    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a"} err="failed to get container status \"74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a\": rpc error: code = NotFound desc = could not find container \"74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a\": container with ID starting with 74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a not found: ID does not exist"
Jul 22 21:03:19.787956 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.787924    2583 scope.go:117] "RemoveContainer" containerID="a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3"
Jul 22 21:03:19.788196 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:03:19.788161    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3\": container with ID starting with a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3 not found: ID does not exist" containerID="a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3"
Jul 22 21:03:19.788196 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.788186    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3"} err="failed to get container status \"a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3\": rpc error: code = NotFound desc = could not find container \"a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3\": container with ID starting with a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3 not found: ID does not exist"
Jul 22 21:03:19.788289 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.788201    2583 scope.go:117] "RemoveContainer" containerID="01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27"
Jul 22 21:03:19.788446 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:03:19.788429    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27\": container with ID starting with 01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27 not found: ID does not exist" containerID="01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27"
Jul 22 21:03:19.788490 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.788455    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27"} err="failed to get container status \"01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27\": rpc error: code = NotFound desc = could not find container \"01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27\": container with ID starting with 01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27 not found: ID does not exist"
Jul 22 21:03:19.788490 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.788473    2583 scope.go:117] "RemoveContainer" containerID="5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993"
Jul 22 21:03:19.788694 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.788670    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993"} err="failed to get container status \"5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993\": rpc error: code = NotFound desc = could not find container \"5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993\": container with ID starting with 5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993 not found: ID does not exist"
Jul 22 21:03:19.788734 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.788695    2583 scope.go:117] "RemoveContainer" containerID="a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c"
Jul 22 21:03:19.788896 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.788881    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c"} err="failed to get container status \"a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c\": rpc error: code = NotFound desc = could not find container \"a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c\": container with ID starting with a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c not found: ID does not exist"
Jul 22 21:03:19.788936 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.788896    2583 scope.go:117] "RemoveContainer" containerID="f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714"
Jul 22 21:03:19.789069 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.789045    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714"} err="failed to get container status \"f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714\": rpc error: code = NotFound desc = could not find container \"f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714\": container with ID starting with f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714 not found: ID does not exist"
Jul 22 21:03:19.789131 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.789070    2583 scope.go:117] "RemoveContainer" containerID="66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb"
Jul 22 21:03:19.789303 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.789286    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb"} err="failed to get container status \"66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb\": rpc error: code = NotFound desc = could not find container \"66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb\": container with ID starting with 66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb not found: ID does not exist"
Jul 22 21:03:19.789363 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.789303    2583 scope.go:117] "RemoveContainer" containerID="74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a"
Jul 22 21:03:19.789512 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.789494    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a"} err="failed to get container status \"74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a\": rpc error: code = NotFound desc = could not find container \"74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a\": container with ID starting with 74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a not found: ID does not exist"
Jul 22 21:03:19.789553 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.789513    2583 scope.go:117] "RemoveContainer" containerID="a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3"
Jul 22 21:03:19.789723 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.789706    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3"} err="failed to get container status \"a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3\": rpc error: code = NotFound desc = could not find container \"a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3\": container with ID starting with a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3 not found: ID does not exist"
Jul 22 21:03:19.789772 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.789734    2583 scope.go:117] "RemoveContainer" containerID="01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27"
Jul 22 21:03:19.789936 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.789921    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27"} err="failed to get container status \"01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27\": rpc error: code = NotFound desc = could not find container \"01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27\": container with ID starting with 01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27 not found: ID does not exist"
Jul 22 21:03:19.789978 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.789937    2583 scope.go:117] "RemoveContainer" containerID="5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993"
Jul 22 21:03:19.790162 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.790147    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993"} err="failed to get container status \"5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993\": rpc error: code = NotFound desc = could not find container \"5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993\": container with ID starting with 5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993 not found: ID does not exist"
Jul 22 21:03:19.790162 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.790162    2583 scope.go:117] "RemoveContainer" containerID="a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c"
Jul 22 21:03:19.790349 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.790331    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c"} err="failed to get container status \"a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c\": rpc error: code = NotFound desc = could not find container \"a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c\": container with ID starting with a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c not found: ID does not exist"
Jul 22 21:03:19.790395 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.790350    2583 scope.go:117] "RemoveContainer" containerID="f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714"
Jul 22 21:03:19.790563 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.790545    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714"} err="failed to get container status \"f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714\": rpc error: code = NotFound desc = could not find container \"f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714\": container with ID starting with f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714 not found: ID does not exist"
Jul 22 21:03:19.790617 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.790574    2583 scope.go:117] "RemoveContainer" containerID="66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb"
Jul 22 21:03:19.790788 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.790772    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb"} err="failed to get container status \"66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb\": rpc error: code = NotFound desc = could not find container \"66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb\": container with ID starting with 66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb not found: ID does not exist"
Jul 22 21:03:19.790834 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.790788    2583 scope.go:117] "RemoveContainer" containerID="74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a"
Jul 22 21:03:19.791005 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.790987    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a"} err="failed to get container status \"74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a\": rpc error: code = NotFound desc = could not find container \"74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a\": container with ID starting with 74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a not found: ID does not exist"
Jul 22 21:03:19.791052 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.791005    2583 scope.go:117] "RemoveContainer" containerID="a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3"
Jul 22 21:03:19.791249 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.791232    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3"} err="failed to get container status \"a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3\": rpc error: code = NotFound desc = could not find container \"a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3\": container with ID starting with a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3 not found: ID does not exist"
Jul 22 21:03:19.791287 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.791249    2583 scope.go:117] "RemoveContainer" containerID="01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27"
Jul 22 21:03:19.791481 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.791463    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27"} err="failed to get container status \"01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27\": rpc error: code = NotFound desc = could not find container \"01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27\": container with ID starting with 01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27 not found: ID does not exist"
Jul 22 21:03:19.791525 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.791482    2583 scope.go:117] "RemoveContainer" containerID="5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993"
Jul 22 21:03:19.791671 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.791656    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993"} err="failed to get container status \"5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993\": rpc error: code = NotFound desc = could not find container \"5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993\": container with ID starting with 5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993 not found: ID does not exist"
Jul 22 21:03:19.791714 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.791672    2583 scope.go:117] "RemoveContainer" containerID="a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c"
Jul 22 21:03:19.791906 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.791889    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c"} err="failed to get container status \"a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c\": rpc error: code = NotFound desc = could not find container \"a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c\": container with ID starting with a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c not found: ID does not exist"
Jul 22 21:03:19.791946 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.791908    2583 scope.go:117] "RemoveContainer" containerID="f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714"
Jul 22 21:03:19.792096 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.792080    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714"} err="failed to get container status \"f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714\": rpc error: code = NotFound desc = could not find container \"f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714\": container with ID starting with f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714 not found: ID does not exist"
Jul 22 21:03:19.792172 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.792096    2583 scope.go:117] "RemoveContainer" containerID="66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb"
Jul 22 21:03:19.792355 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.792340    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb"} err="failed to get container status \"66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb\": rpc error: code = NotFound desc = could not find container \"66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb\": container with ID starting with 66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb not found: ID does not exist"
Jul 22 21:03:19.792397 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.792357    2583 scope.go:117] "RemoveContainer" containerID="74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a"
Jul 22 21:03:19.792560 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.792542    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a"} err="failed to get container status \"74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a\": rpc error: code = NotFound desc = could not find container \"74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a\": container with ID starting with 74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a not found: ID does not exist"
Jul 22 21:03:19.792602 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.792561    2583 scope.go:117] "RemoveContainer" containerID="a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3"
Jul 22 21:03:19.792773 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.792757    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3"} err="failed to get container status \"a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3\": rpc error: code = NotFound desc = could not find container \"a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3\": container with ID starting with a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3 not found: ID does not exist"
Jul 22 21:03:19.792816 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.792773    2583 scope.go:117] "RemoveContainer" containerID="01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27"
Jul 22 21:03:19.792960 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.792946    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27"} err="failed to get container status \"01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27\": rpc error: code = NotFound desc = could not find container \"01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27\": container with ID starting with 01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27 not found: ID does not exist"
Jul 22 21:03:19.793002 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.792962    2583 scope.go:117] "RemoveContainer" containerID="5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993"
Jul 22 21:03:19.793203 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.793187    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993"} err="failed to get container status \"5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993\": rpc error: code = NotFound desc = could not find container \"5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993\": container with ID starting with 5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993 not found: ID does not exist"
Jul 22 21:03:19.793262 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.793203    2583 scope.go:117] "RemoveContainer" containerID="a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c"
Jul 22 21:03:19.793372 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.793355    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c"} err="failed to get container status \"a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c\": rpc error: code = NotFound desc = could not find container \"a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c\": container with ID starting with a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c not found: ID does not exist"
Jul 22 21:03:19.793406 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.793373    2583 scope.go:117] "RemoveContainer" containerID="f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714"
Jul 22 21:03:19.793593 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.793576    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714"} err="failed to get container status \"f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714\": rpc error: code = NotFound desc = could not find container \"f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714\": container with ID starting with f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714 not found: ID does not exist"
Jul 22 21:03:19.793629 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.793595    2583 scope.go:117] "RemoveContainer" containerID="66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb"
Jul 22 21:03:19.793840 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.793824    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb"} err="failed to get container status \"66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb\": rpc error: code = NotFound desc = could not find container \"66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb\": container with ID starting with 66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb not found: ID does not exist"
Jul 22 21:03:19.793886 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.793840    2583 scope.go:117] "RemoveContainer" containerID="74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a"
Jul 22 21:03:19.794028 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.794015    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a"} err="failed to get container status \"74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a\": rpc error: code = NotFound desc = could not find container \"74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a\": container with ID starting with 74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a not found: ID does not exist"
Jul 22 21:03:19.794068 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.794028    2583 scope.go:117] "RemoveContainer" containerID="a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3"
Jul 22 21:03:19.794267 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.794249    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3"} err="failed to get container status \"a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3\": rpc error: code = NotFound desc = could not find container \"a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3\": container with ID starting with a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3 not found: ID does not exist"
Jul 22 21:03:19.794339 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.794268    2583 scope.go:117] "RemoveContainer" containerID="01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27"
Jul 22 21:03:19.794480 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.794465    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27"} err="failed to get container status \"01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27\": rpc error: code = NotFound desc = could not find container \"01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27\": container with ID starting with 01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27 not found: ID does not exist"
Jul 22 21:03:19.794527 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.794479    2583 scope.go:117] "RemoveContainer" containerID="5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993"
Jul 22 21:03:19.794717 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.794702    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993"} err="failed to get container status \"5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993\": rpc error: code = NotFound desc = could not find container \"5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993\": container with ID starting with 5e163d0e6ea3ce61de42b06db9288de4d2b6155a21f4bf984104d0832b113993 not found: ID does not exist"
Jul 22 21:03:19.794759 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.794717    2583 scope.go:117] "RemoveContainer" containerID="a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c"
Jul 22 21:03:19.794937 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.794918    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c"} err="failed to get container status \"a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c\": rpc error: code = NotFound desc = could not find container \"a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c\": container with ID starting with a3f79c9f4bb63ac728b18c3ed728158c3a5aba6d9a190de0323582eb32e63d2c not found: ID does not exist"
Jul 22 21:03:19.794996 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.794938    2583 scope.go:117] "RemoveContainer" containerID="f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714"
Jul 22 21:03:19.795153 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.795138    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714"} err="failed to get container status \"f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714\": rpc error: code = NotFound desc = could not find container \"f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714\": container with ID starting with f288aaa876322330f512f0d4616c2a00a8c7ac2b279c5a731b77a43ac5db5714 not found: ID does not exist"
Jul 22 21:03:19.795217 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.795153    2583 scope.go:117] "RemoveContainer" containerID="66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb"
Jul 22 21:03:19.795403 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.795374    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb"} err="failed to get container status \"66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb\": rpc error: code = NotFound desc = could not find container \"66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb\": container with ID starting with 66fd0cac0edc78a94498608d24836eca053acc253e0d6f3190b47ad76970f9fb not found: ID does not exist"
Jul 22 21:03:19.795486 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.795433    2583 scope.go:117] "RemoveContainer" containerID="74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a"
Jul 22 21:03:19.795806 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.795782    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a"} err="failed to get container status \"74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a\": rpc error: code = NotFound desc = could not find container \"74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a\": container with ID starting with 74afb25ab58c652d902f1dab23fd4dc6f3afd1fa1916fc2041a8e667e9d8aa9a not found: ID does not exist"
Jul 22 21:03:19.795806 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.795807    2583 scope.go:117] "RemoveContainer" containerID="a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3"
Jul 22 21:03:19.796242 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.796222    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3"} err="failed to get container status \"a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3\": rpc error: code = NotFound desc = could not find container \"a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3\": container with ID starting with a3a89307e9d4bafb49f93c2a58dbb0b32f5acaeee2192d54f537f81dbefe6bf3 not found: ID does not exist"
Jul 22 21:03:19.796347 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.796243    2583 scope.go:117] "RemoveContainer" containerID="01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27"
Jul 22 21:03:19.796626 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.796605    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27"} err="failed to get container status \"01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27\": rpc error: code = NotFound desc = could not find container \"01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27\": container with ID starting with 01cb22907f7c45e8be4547b5cefd60855efbd4dff49bb754107a420993bc9b27 not found: ID does not exist"
Jul 22 21:03:19.797382 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.797367    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 21:03:19.797604 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.797593    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="init-config-reloader"
Jul 22 21:03:19.797642 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.797606    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="init-config-reloader"
Jul 22 21:03:19.797642 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.797620    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="thanos-sidecar"
Jul 22 21:03:19.797642 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.797625    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="thanos-sidecar"
Jul 22 21:03:19.797642 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.797633    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="prometheus"
Jul 22 21:03:19.797642 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.797639    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="prometheus"
Jul 22 21:03:19.797785 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.797644    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="kube-rbac-proxy-thanos"
Jul 22 21:03:19.797785 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.797649    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="kube-rbac-proxy-thanos"
Jul 22 21:03:19.797785 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.797657    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="kube-rbac-proxy-web"
Jul 22 21:03:19.797785 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.797661    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="kube-rbac-proxy-web"
Jul 22 21:03:19.797785 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.797668    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="config-reloader"
Jul 22 21:03:19.797785 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.797673    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="config-reloader"
Jul 22 21:03:19.797785 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.797677    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="kube-rbac-proxy"
Jul 22 21:03:19.797785 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.797683    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="kube-rbac-proxy"
Jul 22 21:03:19.797785 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.797723    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="thanos-sidecar"
Jul 22 21:03:19.797785 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.797730    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="kube-rbac-proxy-web"
Jul 22 21:03:19.797785 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.797735    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="kube-rbac-proxy"
Jul 22 21:03:19.797785 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.797741    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="config-reloader"
Jul 22 21:03:19.797785 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.797755    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="kube-rbac-proxy-thanos"
Jul 22 21:03:19.797785 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.797760    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" containerName="prometheus"
Jul 22 21:03:19.802462 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.802448    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:19.804999 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.804962    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 21:03:19.804999 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.804962    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 21:03:19.805256 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.805236    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 21:03:19.805399 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.805383    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 21:03:19.805529 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.805511    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 21:03:19.805599 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.805574    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 21:03:19.805664 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.805610    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 21:03:19.805664 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.805613    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 21:03:19.805775 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.805664    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-69o5sd8mjhji1\""
Jul 22 21:03:19.805775 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.805679    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 21:03:19.805775 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.805615    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 21:03:19.805962 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.805945    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-n2gng\""
Jul 22 21:03:19.806123 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.806094    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 21:03:19.806195 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.805954    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 21:03:19.806294 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.806272    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 21:03:19.811140 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.811102    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 21:03:19.814342 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.814325    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 21:03:19.826919 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.826889    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 21:03:19.957631 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.957523    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:19.957631 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.957577    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b91b3bd-ee9c-4512-b628-cb2c877df4af-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:19.957631 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.957600    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b91b3bd-ee9c-4512-b628-cb2c877df4af-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:19.957631 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.957622    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0b91b3bd-ee9c-4512-b628-cb2c877df4af-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:19.958205 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.957663    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b91b3bd-ee9c-4512-b628-cb2c877df4af-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:19.958205 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.957730    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b91b3bd-ee9c-4512-b628-cb2c877df4af-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:19.958205 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.957760    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:19.958205 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.957777    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8wnp\" (UniqueName: \"kubernetes.io/projected/0b91b3bd-ee9c-4512-b628-cb2c877df4af-kube-api-access-g8wnp\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:19.958205 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.957796    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:19.958205 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.957817    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0b91b3bd-ee9c-4512-b628-cb2c877df4af-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:19.958205 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.957832    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b91b3bd-ee9c-4512-b628-cb2c877df4af-config-out\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:19.958205 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.957850    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:19.958205 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.957875    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0b91b3bd-ee9c-4512-b628-cb2c877df4af-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:19.958205 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.957894    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:19.958205 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.957916    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-config\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:19.958205 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.957931    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b91b3bd-ee9c-4512-b628-cb2c877df4af-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:19.958205 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.957967    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:19.958205 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.957998    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:19.958205 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.958032    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0b91b3bd-ee9c-4512-b628-cb2c877df4af-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:19.958205 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:19.958050    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-web-config\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.058902 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.058866    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.059035 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.058917    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.059035 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.058941    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0b91b3bd-ee9c-4512-b628-cb2c877df4af-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.059035 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.058960    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-web-config\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.059035 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.058989    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.059035 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.059013    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b91b3bd-ee9c-4512-b628-cb2c877df4af-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.059035 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.059031    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b91b3bd-ee9c-4512-b628-cb2c877df4af-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.059371 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.059050    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0b91b3bd-ee9c-4512-b628-cb2c877df4af-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.059371 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.059072    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b91b3bd-ee9c-4512-b628-cb2c877df4af-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.059371 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.059097    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b91b3bd-ee9c-4512-b628-cb2c877df4af-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.059371 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.059135    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.059371 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.059159    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8wnp\" (UniqueName: \"kubernetes.io/projected/0b91b3bd-ee9c-4512-b628-cb2c877df4af-kube-api-access-g8wnp\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.059371 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.059185    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.059371 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.059212    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0b91b3bd-ee9c-4512-b628-cb2c877df4af-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.059371 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.059239    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b91b3bd-ee9c-4512-b628-cb2c877df4af-config-out\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.059371 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.059257    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.059371 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.059273    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0b91b3bd-ee9c-4512-b628-cb2c877df4af-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.059371 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.059295    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.059371 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.059333    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-config\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.059371 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.059358    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b91b3bd-ee9c-4512-b628-cb2c877df4af-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.059981 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.059938    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b91b3bd-ee9c-4512-b628-cb2c877df4af-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.060765 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.060733    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b91b3bd-ee9c-4512-b628-cb2c877df4af-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.061397 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.061368    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b91b3bd-ee9c-4512-b628-cb2c877df4af-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.062018 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.061994    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0b91b3bd-ee9c-4512-b628-cb2c877df4af-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.062716 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.062609    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-web-config\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.063845 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.062716    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.063845 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.062883    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.063845 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.062938    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.063845 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.062995    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.063845 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.063198    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0b91b3bd-ee9c-4512-b628-cb2c877df4af-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.063845 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.063466    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0b91b3bd-ee9c-4512-b628-cb2c877df4af-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.063845 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.063682    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0b91b3bd-ee9c-4512-b628-cb2c877df4af-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.064188 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.064038    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b91b3bd-ee9c-4512-b628-cb2c877df4af-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.064560 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.064536    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b91b3bd-ee9c-4512-b628-cb2c877df4af-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.064834 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.064816    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.065351 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.065324    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.065594 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.065577    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b91b3bd-ee9c-4512-b628-cb2c877df4af-config-out\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.065661 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.065635    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.066240 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.066221    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b91b3bd-ee9c-4512-b628-cb2c877df4af-config\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.071574 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.071551    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8wnp\" (UniqueName: \"kubernetes.io/projected/0b91b3bd-ee9c-4512-b628-cb2c877df4af-kube-api-access-g8wnp\") pod \"prometheus-k8s-0\" (UID: \"0b91b3bd-ee9c-4512-b628-cb2c877df4af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.112567 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.112540    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:03:20.253302 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.253225    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 21:03:20.256657 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:03:20.256627    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b91b3bd_ee9c_4512_b628_cb2c877df4af.slice/crio-9ce82fa5c721ae9bfc75efe099c4dee5bddcd3b04fe8a15e3aa59b119048bd93 WatchSource:0}: Error finding container 9ce82fa5c721ae9bfc75efe099c4dee5bddcd3b04fe8a15e3aa59b119048bd93: Status 404 returned error can't find the container with id 9ce82fa5c721ae9bfc75efe099c4dee5bddcd3b04fe8a15e3aa59b119048bd93
Jul 22 21:03:20.409324 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.409295    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff7b2178-3dd0-4058-abb9-fc8057f1079a" path="/var/lib/kubelet/pods/ff7b2178-3dd0-4058-abb9-fc8057f1079a/volumes"
Jul 22 21:03:20.742060 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.742024    2583 generic.go:356] "Generic (PLEG): container finished" podID="0b91b3bd-ee9c-4512-b628-cb2c877df4af" containerID="b7d3eac069952ba3473d425110051a0687b0e62866e570ad11712a1cadc09e6d" exitCode=0
Jul 22 21:03:20.742251 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.742128    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b91b3bd-ee9c-4512-b628-cb2c877df4af","Type":"ContainerDied","Data":"b7d3eac069952ba3473d425110051a0687b0e62866e570ad11712a1cadc09e6d"}
Jul 22 21:03:20.742251 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:20.742203    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b91b3bd-ee9c-4512-b628-cb2c877df4af","Type":"ContainerStarted","Data":"9ce82fa5c721ae9bfc75efe099c4dee5bddcd3b04fe8a15e3aa59b119048bd93"}
Jul 22 21:03:21.751062 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:21.751027    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b91b3bd-ee9c-4512-b628-cb2c877df4af","Type":"ContainerStarted","Data":"12a3bb9ce06607e631b898a83853da31d5f664a66ff5496e12ee90d3c5daccfb"}
Jul 22 21:03:21.751505 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:21.751126    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b91b3bd-ee9c-4512-b628-cb2c877df4af","Type":"ContainerStarted","Data":"0addf061df7d4d32226471042b8e1c4250ed0880b7f2331cecd74c0bdb3083f0"}
Jul 22 21:03:21.751505 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:21.751170    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b91b3bd-ee9c-4512-b628-cb2c877df4af","Type":"ContainerStarted","Data":"1991d435e44ebe538e2fd478b1ce7e4268ba898a552b1b8b3de45394a2a509ab"}
Jul 22 21:03:21.751505 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:21.751210    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b91b3bd-ee9c-4512-b628-cb2c877df4af","Type":"ContainerStarted","Data":"6499e7c26714f6bc5ea716f663a8afb4570067497c561bd89c911cf058f4a57b"}
Jul 22 21:03:21.751505 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:21.751244    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b91b3bd-ee9c-4512-b628-cb2c877df4af","Type":"ContainerStarted","Data":"9d326d66947b38c8c493ef9d5ff33e3dd45b74a73b86346a53ccec8347ce9c25"}
Jul 22 21:03:21.751505 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:21.751280    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b91b3bd-ee9c-4512-b628-cb2c877df4af","Type":"ContainerStarted","Data":"75d0c4cb32519a62772d67de1a8a35445871e8d960e59100ba227b63bbc57bdf"}
Jul 22 21:03:21.801209 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:21.801133    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.781897962 podStartE2EDuration="2.801095028s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.197066ms" isStatefulPod=false podCreationTimestamp="2026-07-22 21:03:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:03:21.798315659 +0000 UTC m=+399.822354239" watchObservedRunningTime="2026-07-22 21:03:21.801095028 +0000 UTC m=+399.825133608"
Jul 22 21:03:25.113492 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:03:25.113453    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:04:20.112890 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:04:20.112854    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:04:20.128794 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:04:20.128766    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:04:20.971071 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:04:20.971043    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:05:37.341725 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.341641    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2"]
Jul 22 21:05:37.344999 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.344983    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2"
Jul 22 21:05:37.348078 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.348059    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 21:05:37.348285 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.348274    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 21:05:37.348857 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.348841    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 21:05:37.349901 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.349882    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 21:05:37.350007 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.349910    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wglmk\""
Jul 22 21:05:37.381830 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.381809    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2"]
Jul 22 21:05:37.501808 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.501778    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/03a5a90c-3d48-4dff-98a4-75a9d2d9391a-manifests\") pod \"opendatahub-operator-controller-manager-846644596-zq5z2\" (UID: \"03a5a90c-3d48-4dff-98a4-75a9d2d9391a\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2"
Jul 22 21:05:37.501962 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.501818    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03a5a90c-3d48-4dff-98a4-75a9d2d9391a-webhook-cert\") pod \"opendatahub-operator-controller-manager-846644596-zq5z2\" (UID: \"03a5a90c-3d48-4dff-98a4-75a9d2d9391a\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2"
Jul 22 21:05:37.501962 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.501838    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03a5a90c-3d48-4dff-98a4-75a9d2d9391a-tmp\") pod \"opendatahub-operator-controller-manager-846644596-zq5z2\" (UID: \"03a5a90c-3d48-4dff-98a4-75a9d2d9391a\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2"
Jul 22 21:05:37.501962 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.501933    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds8fl\" (UniqueName: \"kubernetes.io/projected/03a5a90c-3d48-4dff-98a4-75a9d2d9391a-kube-api-access-ds8fl\") pod \"opendatahub-operator-controller-manager-846644596-zq5z2\" (UID: \"03a5a90c-3d48-4dff-98a4-75a9d2d9391a\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2"
Jul 22 21:05:37.502171 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.501990    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/03a5a90c-3d48-4dff-98a4-75a9d2d9391a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-846644596-zq5z2\" (UID: \"03a5a90c-3d48-4dff-98a4-75a9d2d9391a\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2"
Jul 22 21:05:37.603071 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.603047    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/03a5a90c-3d48-4dff-98a4-75a9d2d9391a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-846644596-zq5z2\" (UID: \"03a5a90c-3d48-4dff-98a4-75a9d2d9391a\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2"
Jul 22 21:05:37.603193 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.603079    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/03a5a90c-3d48-4dff-98a4-75a9d2d9391a-manifests\") pod \"opendatahub-operator-controller-manager-846644596-zq5z2\" (UID: \"03a5a90c-3d48-4dff-98a4-75a9d2d9391a\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2"
Jul 22 21:05:37.603193 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.603121    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03a5a90c-3d48-4dff-98a4-75a9d2d9391a-webhook-cert\") pod \"opendatahub-operator-controller-manager-846644596-zq5z2\" (UID: \"03a5a90c-3d48-4dff-98a4-75a9d2d9391a\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2"
Jul 22 21:05:37.603193 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.603153    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03a5a90c-3d48-4dff-98a4-75a9d2d9391a-tmp\") pod \"opendatahub-operator-controller-manager-846644596-zq5z2\" (UID: \"03a5a90c-3d48-4dff-98a4-75a9d2d9391a\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2"
Jul 22 21:05:37.603337 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.603220    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds8fl\" (UniqueName: \"kubernetes.io/projected/03a5a90c-3d48-4dff-98a4-75a9d2d9391a-kube-api-access-ds8fl\") pod \"opendatahub-operator-controller-manager-846644596-zq5z2\" (UID: \"03a5a90c-3d48-4dff-98a4-75a9d2d9391a\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2"
Jul 22 21:05:37.603577 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.603555    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/03a5a90c-3d48-4dff-98a4-75a9d2d9391a-manifests\") pod \"opendatahub-operator-controller-manager-846644596-zq5z2\" (UID: \"03a5a90c-3d48-4dff-98a4-75a9d2d9391a\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2"
Jul 22 21:05:37.605512 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.605493    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03a5a90c-3d48-4dff-98a4-75a9d2d9391a-tmp\") pod \"opendatahub-operator-controller-manager-846644596-zq5z2\" (UID: \"03a5a90c-3d48-4dff-98a4-75a9d2d9391a\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2"
Jul 22 21:05:37.605610 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.605594    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03a5a90c-3d48-4dff-98a4-75a9d2d9391a-webhook-cert\") pod \"opendatahub-operator-controller-manager-846644596-zq5z2\" (UID: \"03a5a90c-3d48-4dff-98a4-75a9d2d9391a\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2"
Jul 22 21:05:37.605726 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.605699    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/03a5a90c-3d48-4dff-98a4-75a9d2d9391a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-846644596-zq5z2\" (UID: \"03a5a90c-3d48-4dff-98a4-75a9d2d9391a\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2"
Jul 22 21:05:37.635950 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.635920    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds8fl\" (UniqueName: \"kubernetes.io/projected/03a5a90c-3d48-4dff-98a4-75a9d2d9391a-kube-api-access-ds8fl\") pod \"opendatahub-operator-controller-manager-846644596-zq5z2\" (UID: \"03a5a90c-3d48-4dff-98a4-75a9d2d9391a\") " pod="opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2"
Jul 22 21:05:37.654606 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.654578    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2"
Jul 22 21:05:37.789172 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:37.789141    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2"]
Jul 22 21:05:37.792460 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:05:37.792438    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a5a90c_3d48_4dff_98a4_75a9d2d9391a.slice/crio-66fd629fb1928a7db64e8f6e7b26f3167727ce3b646401112633dd8371e2a17a WatchSource:0}: Error finding container 66fd629fb1928a7db64e8f6e7b26f3167727ce3b646401112633dd8371e2a17a: Status 404 returned error can't find the container with id 66fd629fb1928a7db64e8f6e7b26f3167727ce3b646401112633dd8371e2a17a
Jul 22 21:05:38.227303 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:38.227271    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2" event={"ID":"03a5a90c-3d48-4dff-98a4-75a9d2d9391a","Type":"ContainerStarted","Data":"66fd629fb1928a7db64e8f6e7b26f3167727ce3b646401112633dd8371e2a17a"}
Jul 22 21:05:41.240302 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:41.240229    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2" event={"ID":"03a5a90c-3d48-4dff-98a4-75a9d2d9391a","Type":"ContainerStarted","Data":"fa2e3e4fab6035363f413290b74ae3b8b21861e4606cace6ecaec024a2e9290b"}
Jul 22 21:05:42.245860 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:42.245823    2583 generic.go:356] "Generic (PLEG): container finished" podID="03a5a90c-3d48-4dff-98a4-75a9d2d9391a" containerID="fa2e3e4fab6035363f413290b74ae3b8b21861e4606cace6ecaec024a2e9290b" exitCode=0
Jul 22 21:05:42.246224 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:42.245916    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2" event={"ID":"03a5a90c-3d48-4dff-98a4-75a9d2d9391a","Type":"ContainerDied","Data":"fa2e3e4fab6035363f413290b74ae3b8b21861e4606cace6ecaec024a2e9290b"}
Jul 22 21:05:43.251582 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:43.251548    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2" event={"ID":"03a5a90c-3d48-4dff-98a4-75a9d2d9391a","Type":"ContainerStarted","Data":"8f03329d9d714c583e577c0f582045a448d0f2b6f3d77e1b3cae097cd813ba83"}
Jul 22 21:05:43.252005 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:43.251646    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2"
Jul 22 21:05:43.276514 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:43.276455    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2" podStartSLOduration=1.677170007 podStartE2EDuration="6.276437371s" totalImagesPullingTime="3.544495325s" totalInitContainerRuntime="1.054772039s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:05:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:05:43.275741584 +0000 UTC m=+541.299780163" watchObservedRunningTime="2026-07-22 21:05:43.276437371 +0000 UTC m=+541.300475951"
Jul 22 21:05:54.257703 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:54.257667    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-846644596-zq5z2"
Jul 22 21:05:56.250924 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:56.250891    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7dc9694985-gdq6j"]
Jul 22 21:05:56.262184 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:56.262160    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7dc9694985-gdq6j"
Jul 22 21:05:56.265482 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:56.265415    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7dc9694985-gdq6j"]
Jul 22 21:05:56.265482 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:56.265453    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 22 21:05:56.266032 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:56.266004    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 22 21:05:56.270422 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:56.266549    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 22 21:05:56.270422 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:56.266918    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 22 21:05:56.270422 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:56.267373    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rl6dp\""
Jul 22 21:05:56.270422 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:56.267523    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 22 21:05:56.357431 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:56.357396    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwhlq\" (UniqueName: \"kubernetes.io/projected/70f3d772-d945-4fa4-84c9-e4eb77720dff-kube-api-access-nwhlq\") pod \"lws-controller-manager-7dc9694985-gdq6j\" (UID: \"70f3d772-d945-4fa4-84c9-e4eb77720dff\") " pod="openshift-lws-operator/lws-controller-manager-7dc9694985-gdq6j"
Jul 22 21:05:56.357546 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:56.357453    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70f3d772-d945-4fa4-84c9-e4eb77720dff-cert\") pod \"lws-controller-manager-7dc9694985-gdq6j\" (UID: \"70f3d772-d945-4fa4-84c9-e4eb77720dff\") " pod="openshift-lws-operator/lws-controller-manager-7dc9694985-gdq6j"
Jul 22 21:05:56.357546 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:56.357499    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/70f3d772-d945-4fa4-84c9-e4eb77720dff-metrics-cert\") pod \"lws-controller-manager-7dc9694985-gdq6j\" (UID: \"70f3d772-d945-4fa4-84c9-e4eb77720dff\") " pod="openshift-lws-operator/lws-controller-manager-7dc9694985-gdq6j"
Jul 22 21:05:56.357620 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:56.357560    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/70f3d772-d945-4fa4-84c9-e4eb77720dff-manager-config\") pod \"lws-controller-manager-7dc9694985-gdq6j\" (UID: \"70f3d772-d945-4fa4-84c9-e4eb77720dff\") " pod="openshift-lws-operator/lws-controller-manager-7dc9694985-gdq6j"
Jul 22 21:05:56.458888 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:56.458852    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwhlq\" (UniqueName: \"kubernetes.io/projected/70f3d772-d945-4fa4-84c9-e4eb77720dff-kube-api-access-nwhlq\") pod \"lws-controller-manager-7dc9694985-gdq6j\" (UID: \"70f3d772-d945-4fa4-84c9-e4eb77720dff\") " pod="openshift-lws-operator/lws-controller-manager-7dc9694985-gdq6j"
Jul 22 21:05:56.458991 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:56.458910    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70f3d772-d945-4fa4-84c9-e4eb77720dff-cert\") pod \"lws-controller-manager-7dc9694985-gdq6j\" (UID: \"70f3d772-d945-4fa4-84c9-e4eb77720dff\") " pod="openshift-lws-operator/lws-controller-manager-7dc9694985-gdq6j"
Jul 22 21:05:56.458991 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:56.458949    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/70f3d772-d945-4fa4-84c9-e4eb77720dff-metrics-cert\") pod \"lws-controller-manager-7dc9694985-gdq6j\" (UID: \"70f3d772-d945-4fa4-84c9-e4eb77720dff\") " pod="openshift-lws-operator/lws-controller-manager-7dc9694985-gdq6j"
Jul 22 21:05:56.459066 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:56.458990    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/70f3d772-d945-4fa4-84c9-e4eb77720dff-manager-config\") pod \"lws-controller-manager-7dc9694985-gdq6j\" (UID: \"70f3d772-d945-4fa4-84c9-e4eb77720dff\") " pod="openshift-lws-operator/lws-controller-manager-7dc9694985-gdq6j"
Jul 22 21:05:56.459621 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:56.459600    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/70f3d772-d945-4fa4-84c9-e4eb77720dff-manager-config\") pod \"lws-controller-manager-7dc9694985-gdq6j\" (UID: \"70f3d772-d945-4fa4-84c9-e4eb77720dff\") " pod="openshift-lws-operator/lws-controller-manager-7dc9694985-gdq6j"
Jul 22 21:05:56.461489 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:56.461468    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70f3d772-d945-4fa4-84c9-e4eb77720dff-cert\") pod \"lws-controller-manager-7dc9694985-gdq6j\" (UID: \"70f3d772-d945-4fa4-84c9-e4eb77720dff\") " pod="openshift-lws-operator/lws-controller-manager-7dc9694985-gdq6j"
Jul 22 21:05:56.461587 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:56.461496    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/70f3d772-d945-4fa4-84c9-e4eb77720dff-metrics-cert\") pod \"lws-controller-manager-7dc9694985-gdq6j\" (UID: \"70f3d772-d945-4fa4-84c9-e4eb77720dff\") " pod="openshift-lws-operator/lws-controller-manager-7dc9694985-gdq6j"
Jul 22 21:05:56.469485 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:56.469454    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwhlq\" (UniqueName: \"kubernetes.io/projected/70f3d772-d945-4fa4-84c9-e4eb77720dff-kube-api-access-nwhlq\") pod \"lws-controller-manager-7dc9694985-gdq6j\" (UID: \"70f3d772-d945-4fa4-84c9-e4eb77720dff\") " pod="openshift-lws-operator/lws-controller-manager-7dc9694985-gdq6j"
Jul 22 21:05:56.575601 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:56.575548    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7dc9694985-gdq6j"
Jul 22 21:05:56.705012 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:56.704985    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7dc9694985-gdq6j"]
Jul 22 21:05:56.706788 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:05:56.706761    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70f3d772_d945_4fa4_84c9_e4eb77720dff.slice/crio-e8622095675a18fe9beec8fd608a25b4b32d151b2ee51c1cf24141f907dce3ce WatchSource:0}: Error finding container e8622095675a18fe9beec8fd608a25b4b32d151b2ee51c1cf24141f907dce3ce: Status 404 returned error can't find the container with id e8622095675a18fe9beec8fd608a25b4b32d151b2ee51c1cf24141f907dce3ce
Jul 22 21:05:57.301505 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:05:57.301470    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7dc9694985-gdq6j" event={"ID":"70f3d772-d945-4fa4-84c9-e4eb77720dff","Type":"ContainerStarted","Data":"e8622095675a18fe9beec8fd608a25b4b32d151b2ee51c1cf24141f907dce3ce"}
Jul 22 21:06:00.317733 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:00.317685    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7dc9694985-gdq6j" event={"ID":"70f3d772-d945-4fa4-84c9-e4eb77720dff","Type":"ContainerStarted","Data":"6dacb1a4e637344ccbaf0bd8af6316f28cd5c3a495fdbb63bf2796a41e1b07e4"}
Jul 22 21:06:00.318146 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:00.317814    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7dc9694985-gdq6j"
Jul 22 21:06:05.999257 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:05.999200    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7dc9694985-gdq6j" podStartSLOduration=7.305247222 podStartE2EDuration="9.999180805s" totalImagesPullingTime="2.693933583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:05:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:06:00.415024162 +0000 UTC m=+558.439062741" watchObservedRunningTime="2026-07-22 21:06:05.999180805 +0000 UTC m=+564.023219384"
Jul 22 21:06:06.000403 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:06.000378    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6766dd8-5shbm"]
Jul 22 21:06:06.003678 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:06.003652    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6766dd8-5shbm"
Jul 22 21:06:06.005873 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:06.005850    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 22 21:06:06.006030 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:06.005988    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 21:06:06.006175 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:06.006093    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 21:06:06.006422 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:06.006395    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 22 21:06:06.006772 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:06.006752    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jkqdq\""
Jul 22 21:06:06.016936 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:06.016915    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6766dd8-5shbm"]
Jul 22 21:06:06.037736 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:06.037702    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de31647a-861d-4587-b2d8-3845d6da0843-tmp\") pod \"kube-auth-proxy-6766dd8-5shbm\" (UID: \"de31647a-861d-4587-b2d8-3845d6da0843\") " pod="openshift-ingress/kube-auth-proxy-6766dd8-5shbm"
Jul 22 21:06:06.037832 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:06.037741    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw6zs\" (UniqueName: \"kubernetes.io/projected/de31647a-861d-4587-b2d8-3845d6da0843-kube-api-access-kw6zs\") pod \"kube-auth-proxy-6766dd8-5shbm\" (UID: \"de31647a-861d-4587-b2d8-3845d6da0843\") " pod="openshift-ingress/kube-auth-proxy-6766dd8-5shbm"
Jul 22 21:06:06.037880 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:06.037842    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de31647a-861d-4587-b2d8-3845d6da0843-tls-certs\") pod \"kube-auth-proxy-6766dd8-5shbm\" (UID: \"de31647a-861d-4587-b2d8-3845d6da0843\") " pod="openshift-ingress/kube-auth-proxy-6766dd8-5shbm"
Jul 22 21:06:06.138570 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:06.138535    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de31647a-861d-4587-b2d8-3845d6da0843-tls-certs\") pod \"kube-auth-proxy-6766dd8-5shbm\" (UID: \"de31647a-861d-4587-b2d8-3845d6da0843\") " pod="openshift-ingress/kube-auth-proxy-6766dd8-5shbm"
Jul 22 21:06:06.138570 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:06.138574    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de31647a-861d-4587-b2d8-3845d6da0843-tmp\") pod \"kube-auth-proxy-6766dd8-5shbm\" (UID: \"de31647a-861d-4587-b2d8-3845d6da0843\") " pod="openshift-ingress/kube-auth-proxy-6766dd8-5shbm"
Jul 22 21:06:06.138754 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:06.138598    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw6zs\" (UniqueName: \"kubernetes.io/projected/de31647a-861d-4587-b2d8-3845d6da0843-kube-api-access-kw6zs\") pod \"kube-auth-proxy-6766dd8-5shbm\" (UID: \"de31647a-861d-4587-b2d8-3845d6da0843\") " pod="openshift-ingress/kube-auth-proxy-6766dd8-5shbm"
Jul 22 21:06:06.140939 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:06.140916    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de31647a-861d-4587-b2d8-3845d6da0843-tmp\") pod \"kube-auth-proxy-6766dd8-5shbm\" (UID: \"de31647a-861d-4587-b2d8-3845d6da0843\") " pod="openshift-ingress/kube-auth-proxy-6766dd8-5shbm"
Jul 22 21:06:06.141429 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:06.141409    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de31647a-861d-4587-b2d8-3845d6da0843-tls-certs\") pod \"kube-auth-proxy-6766dd8-5shbm\" (UID: \"de31647a-861d-4587-b2d8-3845d6da0843\") " pod="openshift-ingress/kube-auth-proxy-6766dd8-5shbm"
Jul 22 21:06:06.148039 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:06.148016    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw6zs\" (UniqueName: \"kubernetes.io/projected/de31647a-861d-4587-b2d8-3845d6da0843-kube-api-access-kw6zs\") pod \"kube-auth-proxy-6766dd8-5shbm\" (UID: \"de31647a-861d-4587-b2d8-3845d6da0843\") " pod="openshift-ingress/kube-auth-proxy-6766dd8-5shbm"
Jul 22 21:06:06.315818 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:06.315749    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6766dd8-5shbm"
Jul 22 21:06:06.446268 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:06.446244    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6766dd8-5shbm"]
Jul 22 21:06:06.448762 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:06:06.448730    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde31647a_861d_4587_b2d8_3845d6da0843.slice/crio-898759b293ab2229a0f1f1567f50f37800f0d4cec8a4d5829e62c367233658ac WatchSource:0}: Error finding container 898759b293ab2229a0f1f1567f50f37800f0d4cec8a4d5829e62c367233658ac: Status 404 returned error can't find the container with id 898759b293ab2229a0f1f1567f50f37800f0d4cec8a4d5829e62c367233658ac
Jul 22 21:06:07.344626 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:07.344593    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6766dd8-5shbm" event={"ID":"de31647a-861d-4587-b2d8-3845d6da0843","Type":"ContainerStarted","Data":"898759b293ab2229a0f1f1567f50f37800f0d4cec8a4d5829e62c367233658ac"}
Jul 22 21:06:10.365001 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:10.364965    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6766dd8-5shbm" event={"ID":"de31647a-861d-4587-b2d8-3845d6da0843","Type":"ContainerStarted","Data":"f59ed78d9d803a382457fc5013558881be1a5b04510041e10b5719607dbff0ca"}
Jul 22 21:06:10.390442 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:10.390390    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6766dd8-5shbm" podStartSLOduration=1.859519769 podStartE2EDuration="5.390375448s" totalImagesPullingTime="3.530855679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:06:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:06:10.389555975 +0000 UTC m=+568.413594554" watchObservedRunningTime="2026-07-22 21:06:10.390375448 +0000 UTC m=+568.414414027"
Jul 22 21:06:11.323264 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:06:11.323236    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7dc9694985-gdq6j"
Jul 22 21:07:48.319461 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:07:48.319426    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-npgfq"]
Jul 22 21:07:48.322675 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:07:48.322655    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-npgfq"
Jul 22 21:07:48.324872 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:07:48.324853    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 22 21:07:48.325094 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:07:48.325074    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 21:07:48.325173 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:07:48.325086    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 21:07:48.325686 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:07:48.325669    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 22 21:07:48.325746 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:07:48.325733    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vnlkb\""
Jul 22 21:07:48.330723 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:07:48.330701    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-npgfq"]
Jul 22 21:07:48.353218 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:07:48.353189    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2ce38d0-2d24-4091-b127-55158509990b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-npgfq\" (UID: \"f2ce38d0-2d24-4091-b127-55158509990b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-npgfq"
Jul 22 21:07:48.353330 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:07:48.353225    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f2ce38d0-2d24-4091-b127-55158509990b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-npgfq\" (UID: \"f2ce38d0-2d24-4091-b127-55158509990b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-npgfq"
Jul 22 21:07:48.353330 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:07:48.353315    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79rmn\" (UniqueName: \"kubernetes.io/projected/f2ce38d0-2d24-4091-b127-55158509990b-kube-api-access-79rmn\") pod \"kuadrant-console-plugin-66b5774985-npgfq\" (UID: \"f2ce38d0-2d24-4091-b127-55158509990b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-npgfq"
Jul 22 21:07:48.453790 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:07:48.453762    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2ce38d0-2d24-4091-b127-55158509990b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-npgfq\" (UID: \"f2ce38d0-2d24-4091-b127-55158509990b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-npgfq"
Jul 22 21:07:48.453942 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:07:48.453805    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f2ce38d0-2d24-4091-b127-55158509990b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-npgfq\" (UID: \"f2ce38d0-2d24-4091-b127-55158509990b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-npgfq"
Jul 22 21:07:48.453942 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:07:48.453860    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79rmn\" (UniqueName: \"kubernetes.io/projected/f2ce38d0-2d24-4091-b127-55158509990b-kube-api-access-79rmn\") pod \"kuadrant-console-plugin-66b5774985-npgfq\" (UID: \"f2ce38d0-2d24-4091-b127-55158509990b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-npgfq"
Jul 22 21:07:48.453942 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:07:48.453892    2583 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 22 21:07:48.454066 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:07:48.453963    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2ce38d0-2d24-4091-b127-55158509990b-plugin-serving-cert podName:f2ce38d0-2d24-4091-b127-55158509990b nodeName:}" failed. No retries permitted until 2026-07-22 21:07:48.953946776 +0000 UTC m=+666.977985335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/f2ce38d0-2d24-4091-b127-55158509990b-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-npgfq" (UID: "f2ce38d0-2d24-4091-b127-55158509990b") : secret "plugin-serving-cert" not found
Jul 22 21:07:48.454487 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:07:48.454468    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f2ce38d0-2d24-4091-b127-55158509990b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-npgfq\" (UID: \"f2ce38d0-2d24-4091-b127-55158509990b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-npgfq"
Jul 22 21:07:48.462211 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:07:48.462189    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79rmn\" (UniqueName: \"kubernetes.io/projected/f2ce38d0-2d24-4091-b127-55158509990b-kube-api-access-79rmn\") pod \"kuadrant-console-plugin-66b5774985-npgfq\" (UID: \"f2ce38d0-2d24-4091-b127-55158509990b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-npgfq"
Jul 22 21:07:48.956880 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:07:48.956844    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2ce38d0-2d24-4091-b127-55158509990b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-npgfq\" (UID: \"f2ce38d0-2d24-4091-b127-55158509990b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-npgfq"
Jul 22 21:07:48.959494 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:07:48.959475    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2ce38d0-2d24-4091-b127-55158509990b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-npgfq\" (UID: \"f2ce38d0-2d24-4091-b127-55158509990b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-npgfq"
Jul 22 21:07:49.232372 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:07:49.232275    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-npgfq"
Jul 22 21:07:49.357611 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:07:49.357587    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-npgfq"]
Jul 22 21:07:49.360406 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:07:49.360378    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2ce38d0_2d24_4091_b127_55158509990b.slice/crio-af5fd9f611c491a06b5ccdc68ead029ed58a8de0cd14768674b2847addff9274 WatchSource:0}: Error finding container af5fd9f611c491a06b5ccdc68ead029ed58a8de0cd14768674b2847addff9274: Status 404 returned error can't find the container with id af5fd9f611c491a06b5ccdc68ead029ed58a8de0cd14768674b2847addff9274
Jul 22 21:07:49.361696 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:07:49.361678    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 21:07:49.738308 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:07:49.738273    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-npgfq" event={"ID":"f2ce38d0-2d24-4091-b127-55158509990b","Type":"ContainerStarted","Data":"af5fd9f611c491a06b5ccdc68ead029ed58a8de0cd14768674b2847addff9274"}
Jul 22 21:08:10.833158 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:10.833118    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-npgfq" event={"ID":"f2ce38d0-2d24-4091-b127-55158509990b","Type":"ContainerStarted","Data":"01d2e5e32cc68759be3585c0e98fdba076bdc2d45d21b4834632901987f984d8"}
Jul 22 21:08:10.854729 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:10.854669    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-npgfq" podStartSLOduration=1.602520263 podStartE2EDuration="22.85465387s" totalImagesPullingTime="21.252133607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:08:10.853545051 +0000 UTC m=+688.877583631" watchObservedRunningTime="2026-07-22 21:08:10.85465387 +0000 UTC m=+688.878692449"
Jul 22 21:08:28.886768 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:28.886734    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g4klp"]
Jul 22 21:08:28.929709 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:28.929681    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g4klp"]
Jul 22 21:08:28.929879 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:28.929818    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g4klp"
Jul 22 21:08:28.932319 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:28.932299    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 22 21:08:28.981982 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:28.981951    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g4klp"]
Jul 22 21:08:29.006569 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:29.006539    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z9tq\" (UniqueName: \"kubernetes.io/projected/0bece3c7-33da-40c6-b705-48dcb496a5c5-kube-api-access-6z9tq\") pod \"limitador-limitador-64c94fd64f-g4klp\" (UID: \"0bece3c7-33da-40c6-b705-48dcb496a5c5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g4klp"
Jul 22 21:08:29.006729 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:29.006600    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0bece3c7-33da-40c6-b705-48dcb496a5c5-config-file\") pod \"limitador-limitador-64c94fd64f-g4klp\" (UID: \"0bece3c7-33da-40c6-b705-48dcb496a5c5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g4klp"
Jul 22 21:08:29.107998 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:29.107965    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z9tq\" (UniqueName: \"kubernetes.io/projected/0bece3c7-33da-40c6-b705-48dcb496a5c5-kube-api-access-6z9tq\") pod \"limitador-limitador-64c94fd64f-g4klp\" (UID: \"0bece3c7-33da-40c6-b705-48dcb496a5c5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g4klp"
Jul 22 21:08:29.108219 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:29.108026    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0bece3c7-33da-40c6-b705-48dcb496a5c5-config-file\") pod \"limitador-limitador-64c94fd64f-g4klp\" (UID: \"0bece3c7-33da-40c6-b705-48dcb496a5c5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g4klp"
Jul 22 21:08:29.108650 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:29.108630    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0bece3c7-33da-40c6-b705-48dcb496a5c5-config-file\") pod \"limitador-limitador-64c94fd64f-g4klp\" (UID: \"0bece3c7-33da-40c6-b705-48dcb496a5c5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g4klp"
Jul 22 21:08:29.115861 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:29.115839    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z9tq\" (UniqueName: \"kubernetes.io/projected/0bece3c7-33da-40c6-b705-48dcb496a5c5-kube-api-access-6z9tq\") pod \"limitador-limitador-64c94fd64f-g4klp\" (UID: \"0bece3c7-33da-40c6-b705-48dcb496a5c5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g4klp"
Jul 22 21:08:29.240059 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:29.239972    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g4klp"
Jul 22 21:08:29.368262 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:29.368237    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g4klp"]
Jul 22 21:08:29.370943 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:08:29.370911    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bece3c7_33da_40c6_b705_48dcb496a5c5.slice/crio-8f36d9a2451803882e1e462e3528883fa4a1ff59f89317f608b1bd7e4934e1a6 WatchSource:0}: Error finding container 8f36d9a2451803882e1e462e3528883fa4a1ff59f89317f608b1bd7e4934e1a6: Status 404 returned error can't find the container with id 8f36d9a2451803882e1e462e3528883fa4a1ff59f89317f608b1bd7e4934e1a6
Jul 22 21:08:29.885215 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:29.885181    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-ktqqg"]
Jul 22 21:08:29.889896 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:29.889879    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ktqqg"
Jul 22 21:08:29.892532 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:29.892514    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kh4qg\""
Jul 22 21:08:29.896451 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:29.896427    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ktqqg"]
Jul 22 21:08:29.908718 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:29.908697    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g4klp" event={"ID":"0bece3c7-33da-40c6-b705-48dcb496a5c5","Type":"ContainerStarted","Data":"8f36d9a2451803882e1e462e3528883fa4a1ff59f89317f608b1bd7e4934e1a6"}
Jul 22 21:08:29.914192 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:29.914175    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nddzs\" (UniqueName: \"kubernetes.io/projected/85d2e411-7ec4-49a8-8884-a9d1e978c359-kube-api-access-nddzs\") pod \"authorino-75d556bd77-ktqqg\" (UID: \"85d2e411-7ec4-49a8-8884-a9d1e978c359\") " pod="kuadrant-system/authorino-75d556bd77-ktqqg"
Jul 22 21:08:30.014821 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:30.014800    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nddzs\" (UniqueName: \"kubernetes.io/projected/85d2e411-7ec4-49a8-8884-a9d1e978c359-kube-api-access-nddzs\") pod \"authorino-75d556bd77-ktqqg\" (UID: \"85d2e411-7ec4-49a8-8884-a9d1e978c359\") " pod="kuadrant-system/authorino-75d556bd77-ktqqg"
Jul 22 21:08:30.023412 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:30.023392    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nddzs\" (UniqueName: \"kubernetes.io/projected/85d2e411-7ec4-49a8-8884-a9d1e978c359-kube-api-access-nddzs\") pod \"authorino-75d556bd77-ktqqg\" (UID: \"85d2e411-7ec4-49a8-8884-a9d1e978c359\") " pod="kuadrant-system/authorino-75d556bd77-ktqqg"
Jul 22 21:08:30.200320 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:30.200248    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ktqqg"
Jul 22 21:08:30.327837 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:30.327811    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ktqqg"]
Jul 22 21:08:30.331103 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:08:30.331069    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85d2e411_7ec4_49a8_8884_a9d1e978c359.slice/crio-a539d6a4f951457d9d3ea02b4bd33d04ab839ee76e24a487582de067bfaa6c43 WatchSource:0}: Error finding container a539d6a4f951457d9d3ea02b4bd33d04ab839ee76e24a487582de067bfaa6c43: Status 404 returned error can't find the container with id a539d6a4f951457d9d3ea02b4bd33d04ab839ee76e24a487582de067bfaa6c43
Jul 22 21:08:30.915324 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:30.915286    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ktqqg" event={"ID":"85d2e411-7ec4-49a8-8884-a9d1e978c359","Type":"ContainerStarted","Data":"a539d6a4f951457d9d3ea02b4bd33d04ab839ee76e24a487582de067bfaa6c43"}
Jul 22 21:08:34.938219 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:34.938183    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ktqqg" event={"ID":"85d2e411-7ec4-49a8-8884-a9d1e978c359","Type":"ContainerStarted","Data":"1ea4c7dd7147cff1de8d65be42d62cc5a4de5907ab70f11bdf9a8c16192a4f67"}
Jul 22 21:08:34.939718 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:34.939696    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g4klp" event={"ID":"0bece3c7-33da-40c6-b705-48dcb496a5c5","Type":"ContainerStarted","Data":"f6f173c1a50bbb659017819707a776f87faafed9e84c2e2ee593a3e15a643da4"}
Jul 22 21:08:34.939845 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:34.939830    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-g4klp"
Jul 22 21:08:34.987075 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:34.987023    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-ktqqg" podStartSLOduration=1.99388589 podStartE2EDuration="5.987009857s" totalImagesPullingTime="3.993123967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:08:34.985888637 +0000 UTC m=+713.009927216" watchObservedRunningTime="2026-07-22 21:08:34.987009857 +0000 UTC m=+713.011048437"
Jul 22 21:08:35.001460 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:35.001411    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-g4klp" podStartSLOduration=2.049518285 podStartE2EDuration="7.001394321s" totalImagesPullingTime="4.951876036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:08:35.001267375 +0000 UTC m=+713.025305957" watchObservedRunningTime="2026-07-22 21:08:35.001394321 +0000 UTC m=+713.025432900"
Jul 22 21:08:45.945373 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:45.945342    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-g4klp"
Jul 22 21:08:45.962365 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:45.962333    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g4klp"]
Jul 22 21:08:45.984502 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:45.984474    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-g4klp" podUID="0bece3c7-33da-40c6-b705-48dcb496a5c5" containerName="limitador" containerID="cri-o://f6f173c1a50bbb659017819707a776f87faafed9e84c2e2ee593a3e15a643da4" gracePeriod=30
Jul 22 21:08:46.920176 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:46.920155    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g4klp"
Jul 22 21:08:46.960844 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:46.960820    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0bece3c7-33da-40c6-b705-48dcb496a5c5-config-file\") pod \"0bece3c7-33da-40c6-b705-48dcb496a5c5\" (UID: \"0bece3c7-33da-40c6-b705-48dcb496a5c5\") "
Jul 22 21:08:46.961249 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:46.960864    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6z9tq\" (UniqueName: \"kubernetes.io/projected/0bece3c7-33da-40c6-b705-48dcb496a5c5-kube-api-access-6z9tq\") pod \"0bece3c7-33da-40c6-b705-48dcb496a5c5\" (UID: \"0bece3c7-33da-40c6-b705-48dcb496a5c5\") "
Jul 22 21:08:46.961249 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:46.961238    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bece3c7-33da-40c6-b705-48dcb496a5c5-config-file" (OuterVolumeSpecName: "config-file") pod "0bece3c7-33da-40c6-b705-48dcb496a5c5" (UID: "0bece3c7-33da-40c6-b705-48dcb496a5c5"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:08:46.963214 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:46.963192    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bece3c7-33da-40c6-b705-48dcb496a5c5-kube-api-access-6z9tq" (OuterVolumeSpecName: "kube-api-access-6z9tq") pod "0bece3c7-33da-40c6-b705-48dcb496a5c5" (UID: "0bece3c7-33da-40c6-b705-48dcb496a5c5"). InnerVolumeSpecName "kube-api-access-6z9tq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:08:46.989794 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:46.989769    2583 generic.go:356] "Generic (PLEG): container finished" podID="0bece3c7-33da-40c6-b705-48dcb496a5c5" containerID="f6f173c1a50bbb659017819707a776f87faafed9e84c2e2ee593a3e15a643da4" exitCode=0
Jul 22 21:08:46.989893 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:46.989816    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g4klp"
Jul 22 21:08:46.989893 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:46.989842    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g4klp" event={"ID":"0bece3c7-33da-40c6-b705-48dcb496a5c5","Type":"ContainerDied","Data":"f6f173c1a50bbb659017819707a776f87faafed9e84c2e2ee593a3e15a643da4"}
Jul 22 21:08:46.989893 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:46.989891    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g4klp" event={"ID":"0bece3c7-33da-40c6-b705-48dcb496a5c5","Type":"ContainerDied","Data":"8f36d9a2451803882e1e462e3528883fa4a1ff59f89317f608b1bd7e4934e1a6"}
Jul 22 21:08:46.990037 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:46.989912    2583 scope.go:117] "RemoveContainer" containerID="f6f173c1a50bbb659017819707a776f87faafed9e84c2e2ee593a3e15a643da4"
Jul 22 21:08:46.998273 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:46.998258    2583 scope.go:117] "RemoveContainer" containerID="f6f173c1a50bbb659017819707a776f87faafed9e84c2e2ee593a3e15a643da4"
Jul 22 21:08:46.998537 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:08:46.998519    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6f173c1a50bbb659017819707a776f87faafed9e84c2e2ee593a3e15a643da4\": container with ID starting with f6f173c1a50bbb659017819707a776f87faafed9e84c2e2ee593a3e15a643da4 not found: ID does not exist" containerID="f6f173c1a50bbb659017819707a776f87faafed9e84c2e2ee593a3e15a643da4"
Jul 22 21:08:46.998596 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:46.998547    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6f173c1a50bbb659017819707a776f87faafed9e84c2e2ee593a3e15a643da4"} err="failed to get container status \"f6f173c1a50bbb659017819707a776f87faafed9e84c2e2ee593a3e15a643da4\": rpc error: code = NotFound desc = could not find container \"f6f173c1a50bbb659017819707a776f87faafed9e84c2e2ee593a3e15a643da4\": container with ID starting with f6f173c1a50bbb659017819707a776f87faafed9e84c2e2ee593a3e15a643da4 not found: ID does not exist"
Jul 22 21:08:47.009024 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:47.009005    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g4klp"]
Jul 22 21:08:47.013331 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:47.013310    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g4klp"]
Jul 22 21:08:47.061634 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:47.061585    2583 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0bece3c7-33da-40c6-b705-48dcb496a5c5-config-file\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:08:47.061634 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:47.061604    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6z9tq\" (UniqueName: \"kubernetes.io/projected/0bece3c7-33da-40c6-b705-48dcb496a5c5-kube-api-access-6z9tq\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:08:48.409468 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:48.409435    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bece3c7-33da-40c6-b705-48dcb496a5c5" path="/var/lib/kubelet/pods/0bece3c7-33da-40c6-b705-48dcb496a5c5/volumes"
Jul 22 21:08:50.617384 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:50.617352    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ph9tg"]
Jul 22 21:08:50.617815 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:50.617658    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bece3c7-33da-40c6-b705-48dcb496a5c5" containerName="limitador"
Jul 22 21:08:50.617815 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:50.617668    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bece3c7-33da-40c6-b705-48dcb496a5c5" containerName="limitador"
Jul 22 21:08:50.617815 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:50.617713    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bece3c7-33da-40c6-b705-48dcb496a5c5" containerName="limitador"
Jul 22 21:08:50.621646 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:50.621628    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ph9tg"
Jul 22 21:08:50.624319 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:50.624293    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 21:08:50.624482 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:50.624341    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 22 21:08:50.625026 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:50.625010    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-czm2n\""
Jul 22 21:08:50.625144 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:50.625028    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 21:08:50.631838 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:50.631812    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ph9tg"]
Jul 22 21:08:50.692782 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:50.692752    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdf24\" (UniqueName: \"kubernetes.io/projected/21de62a3-c7ff-45e1-9daf-d0aec4a8c07c-kube-api-access-gdf24\") pod \"postgres-69fb4594cf-ph9tg\" (UID: \"21de62a3-c7ff-45e1-9daf-d0aec4a8c07c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ph9tg"
Jul 22 21:08:50.692979 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:50.692805    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/21de62a3-c7ff-45e1-9daf-d0aec4a8c07c-data\") pod \"postgres-69fb4594cf-ph9tg\" (UID: \"21de62a3-c7ff-45e1-9daf-d0aec4a8c07c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ph9tg"
Jul 22 21:08:50.793897 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:50.793857    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdf24\" (UniqueName: \"kubernetes.io/projected/21de62a3-c7ff-45e1-9daf-d0aec4a8c07c-kube-api-access-gdf24\") pod \"postgres-69fb4594cf-ph9tg\" (UID: \"21de62a3-c7ff-45e1-9daf-d0aec4a8c07c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ph9tg"
Jul 22 21:08:50.794073 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:50.793906    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/21de62a3-c7ff-45e1-9daf-d0aec4a8c07c-data\") pod \"postgres-69fb4594cf-ph9tg\" (UID: \"21de62a3-c7ff-45e1-9daf-d0aec4a8c07c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ph9tg"
Jul 22 21:08:50.794300 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:50.794281    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/21de62a3-c7ff-45e1-9daf-d0aec4a8c07c-data\") pod \"postgres-69fb4594cf-ph9tg\" (UID: \"21de62a3-c7ff-45e1-9daf-d0aec4a8c07c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ph9tg"
Jul 22 21:08:50.802199 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:50.802181    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdf24\" (UniqueName: \"kubernetes.io/projected/21de62a3-c7ff-45e1-9daf-d0aec4a8c07c-kube-api-access-gdf24\") pod \"postgres-69fb4594cf-ph9tg\" (UID: \"21de62a3-c7ff-45e1-9daf-d0aec4a8c07c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ph9tg"
Jul 22 21:08:50.933346 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:50.933261    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ph9tg"
Jul 22 21:08:51.060187 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:51.060156    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ph9tg"]
Jul 22 21:08:51.061663 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:08:51.061635    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21de62a3_c7ff_45e1_9daf_d0aec4a8c07c.slice/crio-94faa5dc8acbd8c2bb4cbb666b716d4d0d07aa9187f7f27b8d5aa10e7d66cadf WatchSource:0}: Error finding container 94faa5dc8acbd8c2bb4cbb666b716d4d0d07aa9187f7f27b8d5aa10e7d66cadf: Status 404 returned error can't find the container with id 94faa5dc8acbd8c2bb4cbb666b716d4d0d07aa9187f7f27b8d5aa10e7d66cadf
Jul 22 21:08:52.015547 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:52.015466    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ph9tg" event={"ID":"21de62a3-c7ff-45e1-9daf-d0aec4a8c07c","Type":"ContainerStarted","Data":"94faa5dc8acbd8c2bb4cbb666b716d4d0d07aa9187f7f27b8d5aa10e7d66cadf"}
Jul 22 21:08:57.039723 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:57.039688    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ph9tg" event={"ID":"21de62a3-c7ff-45e1-9daf-d0aec4a8c07c","Type":"ContainerStarted","Data":"4b8d91d9b31bc152b6c7b675ff5abf0bb3388ef690ad01f15d647cc59b223e96"}
Jul 22 21:08:57.040086 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:57.039804    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ph9tg"
Jul 22 21:08:57.054877 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:08:57.054830    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ph9tg" podStartSLOduration=2.101925875 podStartE2EDuration="7.054815861s" totalImagesPullingTime="4.952889986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:08:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:08:57.053548553 +0000 UTC m=+735.077587135" watchObservedRunningTime="2026-07-22 21:08:57.054815861 +0000 UTC m=+735.078854440"
Jul 22 21:09:03.074682 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:03.074654    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ph9tg"
Jul 22 21:09:03.604433 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:03.604401    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2g48w"]
Jul 22 21:09:03.613632 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:03.613609    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2g48w"
Jul 22 21:09:03.613789 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:03.613755    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2g48w"]
Jul 22 21:09:03.721039 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:03.721003    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdv5j\" (UniqueName: \"kubernetes.io/projected/5271bcb1-a268-4ddf-9cb2-d440ebbe5788-kube-api-access-jdv5j\") pod \"authorino-5d4b67c446-2g48w\" (UID: \"5271bcb1-a268-4ddf-9cb2-d440ebbe5788\") " pod="kuadrant-system/authorino-5d4b67c446-2g48w"
Jul 22 21:09:03.783423 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:03.783391    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2g48w"]
Jul 22 21:09:03.783600 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:09:03.783580    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-jdv5j], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-2g48w" podUID="5271bcb1-a268-4ddf-9cb2-d440ebbe5788"
Jul 22 21:09:03.822118 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:03.822076    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdv5j\" (UniqueName: \"kubernetes.io/projected/5271bcb1-a268-4ddf-9cb2-d440ebbe5788-kube-api-access-jdv5j\") pod \"authorino-5d4b67c446-2g48w\" (UID: \"5271bcb1-a268-4ddf-9cb2-d440ebbe5788\") " pod="kuadrant-system/authorino-5d4b67c446-2g48w"
Jul 22 21:09:03.829589 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:03.829563    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdv5j\" (UniqueName: \"kubernetes.io/projected/5271bcb1-a268-4ddf-9cb2-d440ebbe5788-kube-api-access-jdv5j\") pod \"authorino-5d4b67c446-2g48w\" (UID: \"5271bcb1-a268-4ddf-9cb2-d440ebbe5788\") " pod="kuadrant-system/authorino-5d4b67c446-2g48w"
Jul 22 21:09:03.870816 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:03.870758    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75f6df7cd5-4kkqx"]
Jul 22 21:09:03.901438 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:03.901417    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75f6df7cd5-4kkqx"]
Jul 22 21:09:03.901543 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:03.901501    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75f6df7cd5-4kkqx"
Jul 22 21:09:03.903893 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:03.903872    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 22 21:09:04.022953 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:04.022928    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5-tls-cert\") pod \"authorino-75f6df7cd5-4kkqx\" (UID: \"bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5\") " pod="kuadrant-system/authorino-75f6df7cd5-4kkqx"
Jul 22 21:09:04.023057 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:04.022968    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8z7r\" (UniqueName: \"kubernetes.io/projected/bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5-kube-api-access-z8z7r\") pod \"authorino-75f6df7cd5-4kkqx\" (UID: \"bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5\") " pod="kuadrant-system/authorino-75f6df7cd5-4kkqx"
Jul 22 21:09:04.071062 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:04.071037    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2g48w"
Jul 22 21:09:04.089975 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:04.089936    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2g48w"
Jul 22 21:09:04.123949 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:04.123897    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5-tls-cert\") pod \"authorino-75f6df7cd5-4kkqx\" (UID: \"bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5\") " pod="kuadrant-system/authorino-75f6df7cd5-4kkqx"
Jul 22 21:09:04.123949 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:04.123931    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8z7r\" (UniqueName: \"kubernetes.io/projected/bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5-kube-api-access-z8z7r\") pod \"authorino-75f6df7cd5-4kkqx\" (UID: \"bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5\") " pod="kuadrant-system/authorino-75f6df7cd5-4kkqx"
Jul 22 21:09:04.126605 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:04.126582    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5-tls-cert\") pod \"authorino-75f6df7cd5-4kkqx\" (UID: \"bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5\") " pod="kuadrant-system/authorino-75f6df7cd5-4kkqx"
Jul 22 21:09:04.134309 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:04.134286    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8z7r\" (UniqueName: \"kubernetes.io/projected/bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5-kube-api-access-z8z7r\") pod \"authorino-75f6df7cd5-4kkqx\" (UID: \"bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5\") " pod="kuadrant-system/authorino-75f6df7cd5-4kkqx"
Jul 22 21:09:04.210076 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:04.210051    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75f6df7cd5-4kkqx"
Jul 22 21:09:04.224341 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:04.224323    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdv5j\" (UniqueName: \"kubernetes.io/projected/5271bcb1-a268-4ddf-9cb2-d440ebbe5788-kube-api-access-jdv5j\") pod \"5271bcb1-a268-4ddf-9cb2-d440ebbe5788\" (UID: \"5271bcb1-a268-4ddf-9cb2-d440ebbe5788\") "
Jul 22 21:09:04.226255 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:04.226229    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5271bcb1-a268-4ddf-9cb2-d440ebbe5788-kube-api-access-jdv5j" (OuterVolumeSpecName: "kube-api-access-jdv5j") pod "5271bcb1-a268-4ddf-9cb2-d440ebbe5788" (UID: "5271bcb1-a268-4ddf-9cb2-d440ebbe5788"). InnerVolumeSpecName "kube-api-access-jdv5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:09:04.325256 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:04.325224    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdv5j\" (UniqueName: \"kubernetes.io/projected/5271bcb1-a268-4ddf-9cb2-d440ebbe5788-kube-api-access-jdv5j\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:09:04.351068 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:04.351038    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75f6df7cd5-4kkqx"]
Jul 22 21:09:04.353172 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:09:04.353147    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc1b07a3_4c5d_4a56_ba8c_c5a61eaef8e5.slice/crio-846bd80b47692983982a656028ae8d5157557541644a3b3fec6f9900249600c1 WatchSource:0}: Error finding container 846bd80b47692983982a656028ae8d5157557541644a3b3fec6f9900249600c1: Status 404 returned error can't find the container with id 846bd80b47692983982a656028ae8d5157557541644a3b3fec6f9900249600c1
Jul 22 21:09:05.077373 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:05.077345    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2g48w"
Jul 22 21:09:05.077468 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:05.077385    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75f6df7cd5-4kkqx" event={"ID":"bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5","Type":"ContainerStarted","Data":"846bd80b47692983982a656028ae8d5157557541644a3b3fec6f9900249600c1"}
Jul 22 21:09:05.100495 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:05.100471    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2g48w"]
Jul 22 21:09:05.105137 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:05.105089    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2g48w"]
Jul 22 21:09:06.083647 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:06.083610    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75f6df7cd5-4kkqx" event={"ID":"bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5","Type":"ContainerStarted","Data":"3082ffd8e98a6cbea6054eb15ae811ff024e675e627d46a2bfc9811ccbd489cd"}
Jul 22 21:09:06.098250 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:06.098203    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75f6df7cd5-4kkqx" podStartSLOduration=2.464811116 podStartE2EDuration="3.098188257s" totalImagesPullingTime="633.377141ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:09:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:09:06.097277992 +0000 UTC m=+744.121316571" watchObservedRunningTime="2026-07-22 21:09:06.098188257 +0000 UTC m=+744.122226837"
Jul 22 21:09:06.121131 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:06.121074    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ktqqg"]
Jul 22 21:09:06.121613 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:06.121315    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-ktqqg" podUID="85d2e411-7ec4-49a8-8884-a9d1e978c359" containerName="authorino" containerID="cri-o://1ea4c7dd7147cff1de8d65be42d62cc5a4de5907ab70f11bdf9a8c16192a4f67" gracePeriod=30
Jul 22 21:09:06.409642 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:06.409604    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5271bcb1-a268-4ddf-9cb2-d440ebbe5788" path="/var/lib/kubelet/pods/5271bcb1-a268-4ddf-9cb2-d440ebbe5788/volumes"
Jul 22 21:09:06.427883 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:06.427858    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ktqqg"
Jul 22 21:09:06.542199 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:06.542172    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nddzs\" (UniqueName: \"kubernetes.io/projected/85d2e411-7ec4-49a8-8884-a9d1e978c359-kube-api-access-nddzs\") pod \"85d2e411-7ec4-49a8-8884-a9d1e978c359\" (UID: \"85d2e411-7ec4-49a8-8884-a9d1e978c359\") "
Jul 22 21:09:06.544473 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:06.544448    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85d2e411-7ec4-49a8-8884-a9d1e978c359-kube-api-access-nddzs" (OuterVolumeSpecName: "kube-api-access-nddzs") pod "85d2e411-7ec4-49a8-8884-a9d1e978c359" (UID: "85d2e411-7ec4-49a8-8884-a9d1e978c359"). InnerVolumeSpecName "kube-api-access-nddzs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:09:06.643009 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:06.642951    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nddzs\" (UniqueName: \"kubernetes.io/projected/85d2e411-7ec4-49a8-8884-a9d1e978c359-kube-api-access-nddzs\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:09:07.088662 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:07.088592    2583 generic.go:356] "Generic (PLEG): container finished" podID="85d2e411-7ec4-49a8-8884-a9d1e978c359" containerID="1ea4c7dd7147cff1de8d65be42d62cc5a4de5907ab70f11bdf9a8c16192a4f67" exitCode=0
Jul 22 21:09:07.088662 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:07.088636    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ktqqg"
Jul 22 21:09:07.088836 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:07.088677    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ktqqg" event={"ID":"85d2e411-7ec4-49a8-8884-a9d1e978c359","Type":"ContainerDied","Data":"1ea4c7dd7147cff1de8d65be42d62cc5a4de5907ab70f11bdf9a8c16192a4f67"}
Jul 22 21:09:07.088836 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:07.088719    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ktqqg" event={"ID":"85d2e411-7ec4-49a8-8884-a9d1e978c359","Type":"ContainerDied","Data":"a539d6a4f951457d9d3ea02b4bd33d04ab839ee76e24a487582de067bfaa6c43"}
Jul 22 21:09:07.088836 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:07.088737    2583 scope.go:117] "RemoveContainer" containerID="1ea4c7dd7147cff1de8d65be42d62cc5a4de5907ab70f11bdf9a8c16192a4f67"
Jul 22 21:09:07.096937 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:07.096921    2583 scope.go:117] "RemoveContainer" containerID="1ea4c7dd7147cff1de8d65be42d62cc5a4de5907ab70f11bdf9a8c16192a4f67"
Jul 22 21:09:07.097296 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:09:07.097278    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ea4c7dd7147cff1de8d65be42d62cc5a4de5907ab70f11bdf9a8c16192a4f67\": container with ID starting with 1ea4c7dd7147cff1de8d65be42d62cc5a4de5907ab70f11bdf9a8c16192a4f67 not found: ID does not exist" containerID="1ea4c7dd7147cff1de8d65be42d62cc5a4de5907ab70f11bdf9a8c16192a4f67"
Jul 22 21:09:07.097371 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:07.097303    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ea4c7dd7147cff1de8d65be42d62cc5a4de5907ab70f11bdf9a8c16192a4f67"} err="failed to get container status \"1ea4c7dd7147cff1de8d65be42d62cc5a4de5907ab70f11bdf9a8c16192a4f67\": rpc error: code = NotFound desc = could not find container \"1ea4c7dd7147cff1de8d65be42d62cc5a4de5907ab70f11bdf9a8c16192a4f67\": container with ID starting with 1ea4c7dd7147cff1de8d65be42d62cc5a4de5907ab70f11bdf9a8c16192a4f67 not found: ID does not exist"
Jul 22 21:09:07.108388 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:07.108367    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ktqqg"]
Jul 22 21:09:07.111899 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:07.111879    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ktqqg"]
Jul 22 21:09:08.409639 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:09:08.409606    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85d2e411-7ec4-49a8-8884-a9d1e978c359" path="/var/lib/kubelet/pods/85d2e411-7ec4-49a8-8884-a9d1e978c359/volumes"
Jul 22 21:10:33.888199 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:33.888166    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"]
Jul 22 21:10:33.888588 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:33.888463    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85d2e411-7ec4-49a8-8884-a9d1e978c359" containerName="authorino"
Jul 22 21:10:33.888588 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:33.888473    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="85d2e411-7ec4-49a8-8884-a9d1e978c359" containerName="authorino"
Jul 22 21:10:33.888588 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:33.888541    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="85d2e411-7ec4-49a8-8884-a9d1e978c359" containerName="authorino"
Jul 22 21:10:33.891327 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:33.891311    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"
Jul 22 21:10:33.894656 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:33.894631    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 21:10:33.894804 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:33.894674    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 21:10:33.894804 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:33.894689    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-s7f6b\""
Jul 22 21:10:33.894804 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:33.894631    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 22 21:10:33.901443 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:33.901417    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"]
Jul 22 21:10:33.964831 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:33.964804    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecd14ed9-d96b-4d91-9af4-4d43a9528c9f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7\" (UID: \"ecd14ed9-d96b-4d91-9af4-4d43a9528c9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"
Jul 22 21:10:33.964961 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:33.964832    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecd14ed9-d96b-4d91-9af4-4d43a9528c9f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7\" (UID: \"ecd14ed9-d96b-4d91-9af4-4d43a9528c9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"
Jul 22 21:10:33.964961 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:33.964861    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecd14ed9-d96b-4d91-9af4-4d43a9528c9f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7\" (UID: \"ecd14ed9-d96b-4d91-9af4-4d43a9528c9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"
Jul 22 21:10:33.965031 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:33.964977    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecd14ed9-d96b-4d91-9af4-4d43a9528c9f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7\" (UID: \"ecd14ed9-d96b-4d91-9af4-4d43a9528c9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"
Jul 22 21:10:33.965031 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:33.965003    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d7th\" (UniqueName: \"kubernetes.io/projected/ecd14ed9-d96b-4d91-9af4-4d43a9528c9f-kube-api-access-5d7th\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7\" (UID: \"ecd14ed9-d96b-4d91-9af4-4d43a9528c9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"
Jul 22 21:10:33.965104 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:33.965091    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecd14ed9-d96b-4d91-9af4-4d43a9528c9f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7\" (UID: \"ecd14ed9-d96b-4d91-9af4-4d43a9528c9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"
Jul 22 21:10:34.066024 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:34.065994    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecd14ed9-d96b-4d91-9af4-4d43a9528c9f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7\" (UID: \"ecd14ed9-d96b-4d91-9af4-4d43a9528c9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"
Jul 22 21:10:34.066024 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:34.066025    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d7th\" (UniqueName: \"kubernetes.io/projected/ecd14ed9-d96b-4d91-9af4-4d43a9528c9f-kube-api-access-5d7th\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7\" (UID: \"ecd14ed9-d96b-4d91-9af4-4d43a9528c9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"
Jul 22 21:10:34.066226 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:34.066068    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecd14ed9-d96b-4d91-9af4-4d43a9528c9f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7\" (UID: \"ecd14ed9-d96b-4d91-9af4-4d43a9528c9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"
Jul 22 21:10:34.066226 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:34.066138    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecd14ed9-d96b-4d91-9af4-4d43a9528c9f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7\" (UID: \"ecd14ed9-d96b-4d91-9af4-4d43a9528c9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"
Jul 22 21:10:34.066226 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:34.066167    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecd14ed9-d96b-4d91-9af4-4d43a9528c9f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7\" (UID: \"ecd14ed9-d96b-4d91-9af4-4d43a9528c9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"
Jul 22 21:10:34.066226 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:34.066191    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecd14ed9-d96b-4d91-9af4-4d43a9528c9f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7\" (UID: \"ecd14ed9-d96b-4d91-9af4-4d43a9528c9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"
Jul 22 21:10:34.066506 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:34.066487    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecd14ed9-d96b-4d91-9af4-4d43a9528c9f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7\" (UID: \"ecd14ed9-d96b-4d91-9af4-4d43a9528c9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"
Jul 22 21:10:34.066579 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:34.066557    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecd14ed9-d96b-4d91-9af4-4d43a9528c9f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7\" (UID: \"ecd14ed9-d96b-4d91-9af4-4d43a9528c9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"
Jul 22 21:10:34.066638 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:34.066599    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecd14ed9-d96b-4d91-9af4-4d43a9528c9f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7\" (UID: \"ecd14ed9-d96b-4d91-9af4-4d43a9528c9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"
Jul 22 21:10:34.068455 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:34.068434    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecd14ed9-d96b-4d91-9af4-4d43a9528c9f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7\" (UID: \"ecd14ed9-d96b-4d91-9af4-4d43a9528c9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"
Jul 22 21:10:34.068683 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:34.068667    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecd14ed9-d96b-4d91-9af4-4d43a9528c9f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7\" (UID: \"ecd14ed9-d96b-4d91-9af4-4d43a9528c9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"
Jul 22 21:10:34.077039 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:34.077020    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d7th\" (UniqueName: \"kubernetes.io/projected/ecd14ed9-d96b-4d91-9af4-4d43a9528c9f-kube-api-access-5d7th\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7\" (UID: \"ecd14ed9-d96b-4d91-9af4-4d43a9528c9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"
Jul 22 21:10:34.201430 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:34.201363    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"
Jul 22 21:10:34.328961 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:34.328919    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"]
Jul 22 21:10:34.331214 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:10:34.331185    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecd14ed9_d96b_4d91_9af4_4d43a9528c9f.slice/crio-479d30d25608fda56893c01fa6321a4a31cb8aab6ce9e4e37c21acf5b8f9efd5 WatchSource:0}: Error finding container 479d30d25608fda56893c01fa6321a4a31cb8aab6ce9e4e37c21acf5b8f9efd5: Status 404 returned error can't find the container with id 479d30d25608fda56893c01fa6321a4a31cb8aab6ce9e4e37c21acf5b8f9efd5
Jul 22 21:10:34.450766 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:34.450728    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7" event={"ID":"ecd14ed9-d96b-4d91-9af4-4d43a9528c9f","Type":"ContainerStarted","Data":"479d30d25608fda56893c01fa6321a4a31cb8aab6ce9e4e37c21acf5b8f9efd5"}
Jul 22 21:10:36.461367 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:36.461330    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7" event={"ID":"ecd14ed9-d96b-4d91-9af4-4d43a9528c9f","Type":"ContainerStarted","Data":"508919437f3e868485c5092d0d4a54d980d10710d83c6dbed18d9f1ea4338fba"}
Jul 22 21:10:36.483841 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:36.483785    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7" podStartSLOduration=2.273883764 podStartE2EDuration="3.483765974s" totalImagesPullingTime="1.20988221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:10:36.48271554 +0000 UTC m=+834.506754118" watchObservedRunningTime="2026-07-22 21:10:36.483765974 +0000 UTC m=+834.507804554"
Jul 22 21:10:44.201570 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:44.201539    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"
Jul 22 21:10:44.201964 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:44.201596    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"
Jul 22 21:10:44.213954 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:44.213933    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"
Jul 22 21:10:44.504318 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:10:44.504237    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7"
Jul 22 21:11:08.306271 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:08.306239    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"]
Jul 22 21:11:08.309989 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:08.309973    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"
Jul 22 21:11:08.312492 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:08.312475    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 22 21:11:08.319035 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:08.319008    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"]
Jul 22 21:11:08.350228 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:08.350197    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7699092c-5e21-4c3f-b5dc-dae25066f291-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh\" (UID: \"7699092c-5e21-4c3f-b5dc-dae25066f291\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"
Jul 22 21:11:08.350343 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:08.350271    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7699092c-5e21-4c3f-b5dc-dae25066f291-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh\" (UID: \"7699092c-5e21-4c3f-b5dc-dae25066f291\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"
Jul 22 21:11:08.350343 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:08.350311    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7699092c-5e21-4c3f-b5dc-dae25066f291-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh\" (UID: \"7699092c-5e21-4c3f-b5dc-dae25066f291\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"
Jul 22 21:11:08.350436 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:08.350359    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7699092c-5e21-4c3f-b5dc-dae25066f291-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh\" (UID: \"7699092c-5e21-4c3f-b5dc-dae25066f291\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"
Jul 22 21:11:08.350436 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:08.350405    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvwdf\" (UniqueName: \"kubernetes.io/projected/7699092c-5e21-4c3f-b5dc-dae25066f291-kube-api-access-xvwdf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh\" (UID: \"7699092c-5e21-4c3f-b5dc-dae25066f291\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"
Jul 22 21:11:08.350511 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:08.350471    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7699092c-5e21-4c3f-b5dc-dae25066f291-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh\" (UID: \"7699092c-5e21-4c3f-b5dc-dae25066f291\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"
Jul 22 21:11:08.451294 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:08.451221    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7699092c-5e21-4c3f-b5dc-dae25066f291-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh\" (UID: \"7699092c-5e21-4c3f-b5dc-dae25066f291\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"
Jul 22 21:11:08.451294 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:08.451266    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7699092c-5e21-4c3f-b5dc-dae25066f291-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh\" (UID: \"7699092c-5e21-4c3f-b5dc-dae25066f291\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"
Jul 22 21:11:08.451477 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:08.451299    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7699092c-5e21-4c3f-b5dc-dae25066f291-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh\" (UID: \"7699092c-5e21-4c3f-b5dc-dae25066f291\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"
Jul 22 21:11:08.451477 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:08.451379    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvwdf\" (UniqueName: \"kubernetes.io/projected/7699092c-5e21-4c3f-b5dc-dae25066f291-kube-api-access-xvwdf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh\" (UID: \"7699092c-5e21-4c3f-b5dc-dae25066f291\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"
Jul 22 21:11:08.451477 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:08.451461    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7699092c-5e21-4c3f-b5dc-dae25066f291-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh\" (UID: \"7699092c-5e21-4c3f-b5dc-dae25066f291\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"
Jul 22 21:11:08.451636 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:08.451493    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7699092c-5e21-4c3f-b5dc-dae25066f291-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh\" (UID: \"7699092c-5e21-4c3f-b5dc-dae25066f291\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"
Jul 22 21:11:08.451696 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:08.451672    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7699092c-5e21-4c3f-b5dc-dae25066f291-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh\" (UID: \"7699092c-5e21-4c3f-b5dc-dae25066f291\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"
Jul 22 21:11:08.451839 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:08.451817    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7699092c-5e21-4c3f-b5dc-dae25066f291-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh\" (UID: \"7699092c-5e21-4c3f-b5dc-dae25066f291\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"
Jul 22 21:11:08.452166 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:08.451939    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7699092c-5e21-4c3f-b5dc-dae25066f291-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh\" (UID: \"7699092c-5e21-4c3f-b5dc-dae25066f291\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"
Jul 22 21:11:08.454242 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:08.454215    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7699092c-5e21-4c3f-b5dc-dae25066f291-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh\" (UID: \"7699092c-5e21-4c3f-b5dc-dae25066f291\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"
Jul 22 21:11:08.454467 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:08.454445    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7699092c-5e21-4c3f-b5dc-dae25066f291-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh\" (UID: \"7699092c-5e21-4c3f-b5dc-dae25066f291\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"
Jul 22 21:11:08.461709 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:08.461684    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvwdf\" (UniqueName: \"kubernetes.io/projected/7699092c-5e21-4c3f-b5dc-dae25066f291-kube-api-access-xvwdf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh\" (UID: \"7699092c-5e21-4c3f-b5dc-dae25066f291\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"
Jul 22 21:11:08.620649 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:08.620624    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"
Jul 22 21:11:08.747770 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:08.747747    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"]
Jul 22 21:11:08.750563 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:11:08.750534    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7699092c_5e21_4c3f_b5dc_dae25066f291.slice/crio-e32215d776716d97e26e8d3d318a5ea6d78b7d4337505d1bbe220a9cceb80a05 WatchSource:0}: Error finding container e32215d776716d97e26e8d3d318a5ea6d78b7d4337505d1bbe220a9cceb80a05: Status 404 returned error can't find the container with id e32215d776716d97e26e8d3d318a5ea6d78b7d4337505d1bbe220a9cceb80a05
Jul 22 21:11:09.596691 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:09.596658    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh" event={"ID":"7699092c-5e21-4c3f-b5dc-dae25066f291","Type":"ContainerStarted","Data":"7379935f360ec3636e0724c89176c2ebb57b9127b268fc9f05381db358ce5896"}
Jul 22 21:11:09.597049 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:09.596708    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh" event={"ID":"7699092c-5e21-4c3f-b5dc-dae25066f291","Type":"ContainerStarted","Data":"e32215d776716d97e26e8d3d318a5ea6d78b7d4337505d1bbe220a9cceb80a05"}
Jul 22 21:11:09.613968 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:09.613923    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh" podStartSLOduration=1.40584271 podStartE2EDuration="1.613908053s" totalImagesPullingTime="208.065343ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:11:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:11:09.611621534 +0000 UTC m=+867.635660111" watchObservedRunningTime="2026-07-22 21:11:09.613908053 +0000 UTC m=+867.637946631"
Jul 22 21:11:18.621464 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:18.621428    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"
Jul 22 21:11:18.621854 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:18.621520    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"
Jul 22 21:11:18.634049 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:18.634027    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"
Jul 22 21:11:18.647528 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:18.647509    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh"
Jul 22 21:11:39.305841 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:39.305748    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"]
Jul 22 21:11:39.309130 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:39.309086    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"
Jul 22 21:11:39.311308 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:39.311289    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 22 21:11:39.319326 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:39.319306    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"]
Jul 22 21:11:39.413176 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:39.413148    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e56549b-599f-4681-9653-f22fa7947fba-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-45ql5\" (UID: \"4e56549b-599f-4681-9653-f22fa7947fba\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"
Jul 22 21:11:39.413296 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:39.413181    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e56549b-599f-4681-9653-f22fa7947fba-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-45ql5\" (UID: \"4e56549b-599f-4681-9653-f22fa7947fba\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"
Jul 22 21:11:39.413296 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:39.413207    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e56549b-599f-4681-9653-f22fa7947fba-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-45ql5\" (UID: \"4e56549b-599f-4681-9653-f22fa7947fba\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"
Jul 22 21:11:39.413296 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:39.413267    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nwwm\" (UniqueName: \"kubernetes.io/projected/4e56549b-599f-4681-9653-f22fa7947fba-kube-api-access-9nwwm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-45ql5\" (UID: \"4e56549b-599f-4681-9653-f22fa7947fba\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"
Jul 22 21:11:39.413391 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:39.413336    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e56549b-599f-4681-9653-f22fa7947fba-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-45ql5\" (UID: \"4e56549b-599f-4681-9653-f22fa7947fba\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"
Jul 22 21:11:39.413426 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:39.413391    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e56549b-599f-4681-9653-f22fa7947fba-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-45ql5\" (UID: \"4e56549b-599f-4681-9653-f22fa7947fba\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"
Jul 22 21:11:39.514541 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:39.514514    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e56549b-599f-4681-9653-f22fa7947fba-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-45ql5\" (UID: \"4e56549b-599f-4681-9653-f22fa7947fba\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"
Jul 22 21:11:39.514649 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:39.514553    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e56549b-599f-4681-9653-f22fa7947fba-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-45ql5\" (UID: \"4e56549b-599f-4681-9653-f22fa7947fba\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"
Jul 22 21:11:39.514649 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:39.514571    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e56549b-599f-4681-9653-f22fa7947fba-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-45ql5\" (UID: \"4e56549b-599f-4681-9653-f22fa7947fba\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"
Jul 22 21:11:39.514649 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:39.514604    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e56549b-599f-4681-9653-f22fa7947fba-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-45ql5\" (UID: \"4e56549b-599f-4681-9653-f22fa7947fba\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"
Jul 22 21:11:39.514649 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:39.514640    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nwwm\" (UniqueName: \"kubernetes.io/projected/4e56549b-599f-4681-9653-f22fa7947fba-kube-api-access-9nwwm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-45ql5\" (UID: \"4e56549b-599f-4681-9653-f22fa7947fba\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"
Jul 22 21:11:39.514857 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:39.514712    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e56549b-599f-4681-9653-f22fa7947fba-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-45ql5\" (UID: \"4e56549b-599f-4681-9653-f22fa7947fba\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"
Jul 22 21:11:39.515045 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:39.515020    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e56549b-599f-4681-9653-f22fa7947fba-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-45ql5\" (UID: \"4e56549b-599f-4681-9653-f22fa7947fba\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"
Jul 22 21:11:39.515144 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:39.515066    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e56549b-599f-4681-9653-f22fa7947fba-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-45ql5\" (UID: \"4e56549b-599f-4681-9653-f22fa7947fba\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"
Jul 22 21:11:39.515144 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:39.515078    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e56549b-599f-4681-9653-f22fa7947fba-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-45ql5\" (UID: \"4e56549b-599f-4681-9653-f22fa7947fba\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"
Jul 22 21:11:39.516947 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:39.516932    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e56549b-599f-4681-9653-f22fa7947fba-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-45ql5\" (UID: \"4e56549b-599f-4681-9653-f22fa7947fba\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"
Jul 22 21:11:39.517226 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:39.517209    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e56549b-599f-4681-9653-f22fa7947fba-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-45ql5\" (UID: \"4e56549b-599f-4681-9653-f22fa7947fba\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"
Jul 22 21:11:39.522223 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:39.522202    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nwwm\" (UniqueName: \"kubernetes.io/projected/4e56549b-599f-4681-9653-f22fa7947fba-kube-api-access-9nwwm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-45ql5\" (UID: \"4e56549b-599f-4681-9653-f22fa7947fba\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"
Jul 22 21:11:39.640810 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:39.640777    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"
Jul 22 21:11:39.767970 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:39.767863    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"]
Jul 22 21:11:39.770750 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:11:39.770723    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e56549b_599f_4681_9653_f22fa7947fba.slice/crio-34dcf711d2de0f52543af722d859fec1b841864406a4a62cb756b5803db41adf WatchSource:0}: Error finding container 34dcf711d2de0f52543af722d859fec1b841864406a4a62cb756b5803db41adf: Status 404 returned error can't find the container with id 34dcf711d2de0f52543af722d859fec1b841864406a4a62cb756b5803db41adf
Jul 22 21:11:40.730075 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:40.730037    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5" event={"ID":"4e56549b-599f-4681-9653-f22fa7947fba","Type":"ContainerStarted","Data":"f9a6fe37e3d141a607d0b0105c334d65e4527faaa90fd7acfb754a7c3b84794c"}
Jul 22 21:11:40.730075 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:40.730082    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5" event={"ID":"4e56549b-599f-4681-9653-f22fa7947fba","Type":"ContainerStarted","Data":"34dcf711d2de0f52543af722d859fec1b841864406a4a62cb756b5803db41adf"}
Jul 22 21:11:40.746915 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:40.746868    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5" podStartSLOduration=1.563832573 podStartE2EDuration="1.746855307s" totalImagesPullingTime="183.022734ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:11:40.745637997 +0000 UTC m=+898.769676575" watchObservedRunningTime="2026-07-22 21:11:40.746855307 +0000 UTC m=+898.770893885"
Jul 22 21:11:49.641706 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:49.641659    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"
Jul 22 21:11:49.641706 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:49.641712    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"
Jul 22 21:11:49.654245 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:49.654219    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"
Jul 22 21:11:49.778990 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:11:49.778966    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-45ql5"
Jul 22 21:12:44.420146 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:12:44.420095    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75f6df7cd5-4kkqx"]
Jul 22 21:12:44.420634 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:12:44.420272    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75f6df7cd5-4kkqx" podUID="bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5" containerName="authorino" containerID="cri-o://3082ffd8e98a6cbea6054eb15ae811ff024e675e627d46a2bfc9811ccbd489cd" gracePeriod=30
Jul 22 21:12:44.661899 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:12:44.661877    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75f6df7cd5-4kkqx"
Jul 22 21:12:44.775196 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:12:44.775101    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8z7r\" (UniqueName: \"kubernetes.io/projected/bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5-kube-api-access-z8z7r\") pod \"bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5\" (UID: \"bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5\") "
Jul 22 21:12:44.775196 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:12:44.775168    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5-tls-cert\") pod \"bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5\" (UID: \"bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5\") "
Jul 22 21:12:44.777333 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:12:44.777304    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5-kube-api-access-z8z7r" (OuterVolumeSpecName: "kube-api-access-z8z7r") pod "bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5" (UID: "bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5"). InnerVolumeSpecName "kube-api-access-z8z7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:12:44.784794 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:12:44.784770    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5" (UID: "bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:12:44.875813 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:12:44.875773    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8z7r\" (UniqueName: \"kubernetes.io/projected/bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5-kube-api-access-z8z7r\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:12:44.875813 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:12:44.875810    2583 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5-tls-cert\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:12:45.012586 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:12:45.012553    2583 generic.go:356] "Generic (PLEG): container finished" podID="bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5" containerID="3082ffd8e98a6cbea6054eb15ae811ff024e675e627d46a2bfc9811ccbd489cd" exitCode=0
Jul 22 21:12:45.012720 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:12:45.012600    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75f6df7cd5-4kkqx"
Jul 22 21:12:45.012720 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:12:45.012603    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75f6df7cd5-4kkqx" event={"ID":"bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5","Type":"ContainerDied","Data":"3082ffd8e98a6cbea6054eb15ae811ff024e675e627d46a2bfc9811ccbd489cd"}
Jul 22 21:12:45.012720 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:12:45.012655    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75f6df7cd5-4kkqx" event={"ID":"bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5","Type":"ContainerDied","Data":"846bd80b47692983982a656028ae8d5157557541644a3b3fec6f9900249600c1"}
Jul 22 21:12:45.012720 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:12:45.012679    2583 scope.go:117] "RemoveContainer" containerID="3082ffd8e98a6cbea6054eb15ae811ff024e675e627d46a2bfc9811ccbd489cd"
Jul 22 21:12:45.021375 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:12:45.021362    2583 scope.go:117] "RemoveContainer" containerID="3082ffd8e98a6cbea6054eb15ae811ff024e675e627d46a2bfc9811ccbd489cd"
Jul 22 21:12:45.021636 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:12:45.021617    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3082ffd8e98a6cbea6054eb15ae811ff024e675e627d46a2bfc9811ccbd489cd\": container with ID starting with 3082ffd8e98a6cbea6054eb15ae811ff024e675e627d46a2bfc9811ccbd489cd not found: ID does not exist" containerID="3082ffd8e98a6cbea6054eb15ae811ff024e675e627d46a2bfc9811ccbd489cd"
Jul 22 21:12:45.021703 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:12:45.021643    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3082ffd8e98a6cbea6054eb15ae811ff024e675e627d46a2bfc9811ccbd489cd"} err="failed to get container status \"3082ffd8e98a6cbea6054eb15ae811ff024e675e627d46a2bfc9811ccbd489cd\": rpc error: code = NotFound desc = could not find container \"3082ffd8e98a6cbea6054eb15ae811ff024e675e627d46a2bfc9811ccbd489cd\": container with ID starting with 3082ffd8e98a6cbea6054eb15ae811ff024e675e627d46a2bfc9811ccbd489cd not found: ID does not exist"
Jul 22 21:12:45.033071 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:12:45.033024    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75f6df7cd5-4kkqx"]
Jul 22 21:12:45.036653 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:12:45.036634    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75f6df7cd5-4kkqx"]
Jul 22 21:12:46.409122 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:12:46.409084    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5" path="/var/lib/kubelet/pods/bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5/volumes"
Jul 22 21:15:00.141478 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:15:00.141405    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745915-7fmnv"]
Jul 22 21:15:00.141904 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:15:00.141789    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5" containerName="authorino"
Jul 22 21:15:00.141904 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:15:00.141811    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5" containerName="authorino"
Jul 22 21:15:00.141904 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:15:00.141860    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc1b07a3-4c5d-4a56-ba8c-c5a61eaef8e5" containerName="authorino"
Jul 22 21:15:00.144940 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:15:00.144925    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745915-7fmnv"
Jul 22 21:15:00.147329 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:15:00.147309    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zz5vc\""
Jul 22 21:15:00.150762 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:15:00.150742    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745915-7fmnv"]
Jul 22 21:15:00.155722 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:15:00.155700    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745915-7fmnv"
Jul 22 21:15:00.278586 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:15:00.278560    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745915-7fmnv"]
Jul 22 21:15:00.280705 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:15:00.280681    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca034350_9cc3_4cab_80c7_ecfcbea07a38.slice/crio-5d9d37fa84a4b3c18585c5f42befb400769410b1103e8251514869cd8901f931 WatchSource:0}: Error finding container 5d9d37fa84a4b3c18585c5f42befb400769410b1103e8251514869cd8901f931: Status 404 returned error can't find the container with id 5d9d37fa84a4b3c18585c5f42befb400769410b1103e8251514869cd8901f931
Jul 22 21:15:00.282605 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:15:00.282586    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 21:15:00.585983 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:15:00.585905    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745915-7fmnv" event={"ID":"ca034350-9cc3-4cab-80c7-ecfcbea07a38","Type":"ContainerStarted","Data":"5d9d37fa84a4b3c18585c5f42befb400769410b1103e8251514869cd8901f931"}
Jul 22 21:15:04.604799 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:15:04.604765    2583 generic.go:356] "Generic (PLEG): container finished" podID="ca034350-9cc3-4cab-80c7-ecfcbea07a38" containerID="ba1fdfa83df44258cf282c95cbda878b2f2119efe2feafdd744a255adb6d8307" exitCode=0
Jul 22 21:15:04.605207 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:15:04.604809    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745915-7fmnv" event={"ID":"ca034350-9cc3-4cab-80c7-ecfcbea07a38","Type":"ContainerDied","Data":"ba1fdfa83df44258cf282c95cbda878b2f2119efe2feafdd744a255adb6d8307"}
Jul 22 21:15:05.733597 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:15:05.733575    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745915-7fmnv"
Jul 22 21:15:06.615372 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:15:06.615343    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745915-7fmnv"
Jul 22 21:15:06.615533 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:15:06.615342    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745915-7fmnv" event={"ID":"ca034350-9cc3-4cab-80c7-ecfcbea07a38","Type":"ContainerDied","Data":"5d9d37fa84a4b3c18585c5f42befb400769410b1103e8251514869cd8901f931"}
Jul 22 21:15:06.615533 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:15:06.615474    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d9d37fa84a4b3c18585c5f42befb400769410b1103e8251514869cd8901f931"
Jul 22 21:23:27.711822 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.711790    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"]
Jul 22 21:23:27.712295 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.712157    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca034350-9cc3-4cab-80c7-ecfcbea07a38" containerName="cleanup"
Jul 22 21:23:27.712295 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.712172    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca034350-9cc3-4cab-80c7-ecfcbea07a38" containerName="cleanup"
Jul 22 21:23:27.712295 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.712234    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca034350-9cc3-4cab-80c7-ecfcbea07a38" containerName="cleanup"
Jul 22 21:23:27.715194 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.715177    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:23:27.717493 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.717473    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-6996b4f4-kserve-self-signed-certs\""
Jul 22 21:23:27.729413 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.729393    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"]
Jul 22 21:23:27.817476 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.817442    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk2vf\" (UniqueName: \"kubernetes.io/projected/f69999cd-9680-4813-b49e-a8e1b9adf2f6-kube-api-access-kk2vf\") pod \"e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x\" (UID: \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\") " pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:23:27.817648 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.817493    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f69999cd-9680-4813-b49e-a8e1b9adf2f6-home\") pod \"e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x\" (UID: \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\") " pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:23:27.817648 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.817521    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f69999cd-9680-4813-b49e-a8e1b9adf2f6-dshm\") pod \"e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x\" (UID: \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\") " pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:23:27.817648 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.817564    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f69999cd-9680-4813-b49e-a8e1b9adf2f6-tmp-dir\") pod \"e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x\" (UID: \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\") " pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:23:27.817648 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.817592    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f69999cd-9680-4813-b49e-a8e1b9adf2f6-model-cache\") pod \"e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x\" (UID: \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\") " pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:23:27.817648 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.817617    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f69999cd-9680-4813-b49e-a8e1b9adf2f6-tls-certs\") pod \"e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x\" (UID: \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\") " pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:23:27.918778 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.918749    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f69999cd-9680-4813-b49e-a8e1b9adf2f6-tls-certs\") pod \"e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x\" (UID: \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\") " pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:23:27.918934 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.918811    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk2vf\" (UniqueName: \"kubernetes.io/projected/f69999cd-9680-4813-b49e-a8e1b9adf2f6-kube-api-access-kk2vf\") pod \"e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x\" (UID: \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\") " pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:23:27.918934 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.918848    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f69999cd-9680-4813-b49e-a8e1b9adf2f6-home\") pod \"e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x\" (UID: \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\") " pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:23:27.918934 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.918869    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f69999cd-9680-4813-b49e-a8e1b9adf2f6-dshm\") pod \"e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x\" (UID: \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\") " pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:23:27.918934 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.918893    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f69999cd-9680-4813-b49e-a8e1b9adf2f6-tmp-dir\") pod \"e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x\" (UID: \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\") " pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:23:27.918934 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.918912    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f69999cd-9680-4813-b49e-a8e1b9adf2f6-model-cache\") pod \"e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x\" (UID: \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\") " pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:23:27.919324 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.919304    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f69999cd-9680-4813-b49e-a8e1b9adf2f6-home\") pod \"e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x\" (UID: \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\") " pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:23:27.919391 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.919360    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f69999cd-9680-4813-b49e-a8e1b9adf2f6-tmp-dir\") pod \"e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x\" (UID: \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\") " pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:23:27.919446 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.919369    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f69999cd-9680-4813-b49e-a8e1b9adf2f6-model-cache\") pod \"e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x\" (UID: \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\") " pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:23:27.921319 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.921295    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f69999cd-9680-4813-b49e-a8e1b9adf2f6-dshm\") pod \"e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x\" (UID: \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\") " pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:23:27.921417 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.921403    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f69999cd-9680-4813-b49e-a8e1b9adf2f6-tls-certs\") pod \"e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x\" (UID: \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\") " pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:23:27.927527 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:27.927508    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk2vf\" (UniqueName: \"kubernetes.io/projected/f69999cd-9680-4813-b49e-a8e1b9adf2f6-kube-api-access-kk2vf\") pod \"e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x\" (UID: \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\") " pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:23:28.024634 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:28.024544    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:23:28.150960 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:28.150860    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"]
Jul 22 21:23:28.153709 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:23:28.153672    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf69999cd_9680_4813_b49e_a8e1b9adf2f6.slice/crio-8cc10072e20e7b4ea8cfd9a79ca0c077390ac22905c2200ebfa2543bd61054ff WatchSource:0}: Error finding container 8cc10072e20e7b4ea8cfd9a79ca0c077390ac22905c2200ebfa2543bd61054ff: Status 404 returned error can't find the container with id 8cc10072e20e7b4ea8cfd9a79ca0c077390ac22905c2200ebfa2543bd61054ff
Jul 22 21:23:28.775593 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:28.775557    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x" event={"ID":"f69999cd-9680-4813-b49e-a8e1b9adf2f6","Type":"ContainerStarted","Data":"e840e777ebbd86f88dc1c9859e5996c15af9fd198d656100312f4d936bbfbf50"}
Jul 22 21:23:28.775593 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:28.775601    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x" event={"ID":"f69999cd-9680-4813-b49e-a8e1b9adf2f6","Type":"ContainerStarted","Data":"8cc10072e20e7b4ea8cfd9a79ca0c077390ac22905c2200ebfa2543bd61054ff"}
Jul 22 21:23:28.791939 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:28.791890    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x" podStartSLOduration=1.7918760379999998 podStartE2EDuration="1.791876038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:23:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:23:28.791030726 +0000 UTC m=+1606.815069307" watchObservedRunningTime="2026-07-22 21:23:28.791876038 +0000 UTC m=+1606.815914616"
Jul 22 21:23:37.597942 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:37.597856    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"]
Jul 22 21:23:37.601670 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:37.601649    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:23:37.604002 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:37.603982    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-6996b4f4-kserve-self-signed-certs\""
Jul 22 21:23:37.613512 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:37.613488    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"]
Jul 22 21:23:37.710480 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:37.710447    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0dd39359-1554-4372-9d75-77f0dc3d3a2f-tls-certs\") pod \"e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv\" (UID: \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\") " pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:23:37.710605 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:37.710497    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0dd39359-1554-4372-9d75-77f0dc3d3a2f-dshm\") pod \"e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv\" (UID: \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\") " pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:23:37.710605 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:37.710581    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0dd39359-1554-4372-9d75-77f0dc3d3a2f-home\") pod \"e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv\" (UID: \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\") " pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:23:37.710677 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:37.710609    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dd39359-1554-4372-9d75-77f0dc3d3a2f-tmp-dir\") pod \"e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv\" (UID: \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\") " pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:23:37.710677 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:37.710628    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0dd39359-1554-4372-9d75-77f0dc3d3a2f-model-cache\") pod \"e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv\" (UID: \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\") " pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:23:37.710677 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:37.710650    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcbzn\" (UniqueName: \"kubernetes.io/projected/0dd39359-1554-4372-9d75-77f0dc3d3a2f-kube-api-access-kcbzn\") pod \"e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv\" (UID: \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\") " pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:23:37.811145 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:37.811085    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0dd39359-1554-4372-9d75-77f0dc3d3a2f-tls-certs\") pod \"e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv\" (UID: \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\") " pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:23:37.811324 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:37.811165    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0dd39359-1554-4372-9d75-77f0dc3d3a2f-dshm\") pod \"e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv\" (UID: \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\") " pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:23:37.811324 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:37.811210    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0dd39359-1554-4372-9d75-77f0dc3d3a2f-home\") pod \"e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv\" (UID: \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\") " pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:23:37.811324 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:37.811234    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dd39359-1554-4372-9d75-77f0dc3d3a2f-tmp-dir\") pod \"e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv\" (UID: \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\") " pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:23:37.811450 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:37.811337    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0dd39359-1554-4372-9d75-77f0dc3d3a2f-model-cache\") pod \"e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv\" (UID: \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\") " pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:23:37.811450 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:37.811388    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcbzn\" (UniqueName: \"kubernetes.io/projected/0dd39359-1554-4372-9d75-77f0dc3d3a2f-kube-api-access-kcbzn\") pod \"e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv\" (UID: \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\") " pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:23:37.811692 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:37.811669    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dd39359-1554-4372-9d75-77f0dc3d3a2f-tmp-dir\") pod \"e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv\" (UID: \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\") " pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:23:37.811802 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:37.811705    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0dd39359-1554-4372-9d75-77f0dc3d3a2f-home\") pod \"e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv\" (UID: \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\") " pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:23:37.811852 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:37.811817    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0dd39359-1554-4372-9d75-77f0dc3d3a2f-model-cache\") pod \"e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv\" (UID: \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\") " pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:23:37.813620 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:37.813594    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0dd39359-1554-4372-9d75-77f0dc3d3a2f-dshm\") pod \"e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv\" (UID: \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\") " pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:23:37.813814 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:37.813796    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0dd39359-1554-4372-9d75-77f0dc3d3a2f-tls-certs\") pod \"e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv\" (UID: \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\") " pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:23:37.818749 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:37.818727    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcbzn\" (UniqueName: \"kubernetes.io/projected/0dd39359-1554-4372-9d75-77f0dc3d3a2f-kube-api-access-kcbzn\") pod \"e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv\" (UID: \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\") " pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:23:37.911437 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:37.911348    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:23:38.025631 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:38.025592    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:23:38.025824 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:38.025647    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:23:38.038150 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:38.038125    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:23:38.045553 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:38.045527    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"]
Jul 22 21:23:38.048020 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:23:38.047995    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0dd39359_1554_4372_9d75_77f0dc3d3a2f.slice/crio-37cebb564533ab9d7a013bfe0d758355a68636a16270c9694200c37dfaa90482 WatchSource:0}: Error finding container 37cebb564533ab9d7a013bfe0d758355a68636a16270c9694200c37dfaa90482: Status 404 returned error can't find the container with id 37cebb564533ab9d7a013bfe0d758355a68636a16270c9694200c37dfaa90482
Jul 22 21:23:38.824181 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:38.824137    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv" event={"ID":"0dd39359-1554-4372-9d75-77f0dc3d3a2f","Type":"ContainerStarted","Data":"59735df73bd2c3e4e9c2874720134dc0b15b4c83eb3443293fba9772d35841e3"}
Jul 22 21:23:38.824613 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:38.824191    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv" event={"ID":"0dd39359-1554-4372-9d75-77f0dc3d3a2f","Type":"ContainerStarted","Data":"37cebb564533ab9d7a013bfe0d758355a68636a16270c9694200c37dfaa90482"}
Jul 22 21:23:38.835851 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:38.835828    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:23:38.840888 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:38.840847    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv" podStartSLOduration=1.840832303 podStartE2EDuration="1.840832303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:23:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:23:38.839534832 +0000 UTC m=+1616.863573412" watchObservedRunningTime="2026-07-22 21:23:38.840832303 +0000 UTC m=+1616.864870882"
Jul 22 21:23:47.912245 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:47.912206    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:23:47.912658 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:47.912286    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:23:47.924801 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:47.924778    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:23:48.882483 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:48.882456    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:23:56.030995 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:56.030956    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"]
Jul 22 21:23:57.600139 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:23:57.600072    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"]
Jul 22 21:24:11.051963 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.051907    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x" podUID="f69999cd-9680-4813-b49e-a8e1b9adf2f6" containerName="main" containerID="cri-o://e840e777ebbd86f88dc1c9859e5996c15af9fd198d656100312f4d936bbfbf50" gracePeriod=45
Jul 22 21:24:11.300067 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.300045    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:24:11.412782 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.412757    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f69999cd-9680-4813-b49e-a8e1b9adf2f6-tls-certs\") pod \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\" (UID: \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\") "
Jul 22 21:24:11.412936 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.412796    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk2vf\" (UniqueName: \"kubernetes.io/projected/f69999cd-9680-4813-b49e-a8e1b9adf2f6-kube-api-access-kk2vf\") pod \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\" (UID: \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\") "
Jul 22 21:24:11.412936 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.412859    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f69999cd-9680-4813-b49e-a8e1b9adf2f6-tmp-dir\") pod \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\" (UID: \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\") "
Jul 22 21:24:11.412936 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.412898    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f69999cd-9680-4813-b49e-a8e1b9adf2f6-dshm\") pod \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\" (UID: \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\") "
Jul 22 21:24:11.412936 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.412924    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f69999cd-9680-4813-b49e-a8e1b9adf2f6-model-cache\") pod \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\" (UID: \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\") "
Jul 22 21:24:11.413188 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.412943    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f69999cd-9680-4813-b49e-a8e1b9adf2f6-home\") pod \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\" (UID: \"f69999cd-9680-4813-b49e-a8e1b9adf2f6\") "
Jul 22 21:24:11.413263 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.413232    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69999cd-9680-4813-b49e-a8e1b9adf2f6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f69999cd-9680-4813-b49e-a8e1b9adf2f6" (UID: "f69999cd-9680-4813-b49e-a8e1b9adf2f6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:24:11.413263 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.413218    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69999cd-9680-4813-b49e-a8e1b9adf2f6-model-cache" (OuterVolumeSpecName: "model-cache") pod "f69999cd-9680-4813-b49e-a8e1b9adf2f6" (UID: "f69999cd-9680-4813-b49e-a8e1b9adf2f6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:24:11.413378 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.413293    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69999cd-9680-4813-b49e-a8e1b9adf2f6-home" (OuterVolumeSpecName: "home") pod "f69999cd-9680-4813-b49e-a8e1b9adf2f6" (UID: "f69999cd-9680-4813-b49e-a8e1b9adf2f6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:24:11.415269 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.415238    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69999cd-9680-4813-b49e-a8e1b9adf2f6-dshm" (OuterVolumeSpecName: "dshm") pod "f69999cd-9680-4813-b49e-a8e1b9adf2f6" (UID: "f69999cd-9680-4813-b49e-a8e1b9adf2f6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:24:11.415386 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.415267    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f69999cd-9680-4813-b49e-a8e1b9adf2f6-kube-api-access-kk2vf" (OuterVolumeSpecName: "kube-api-access-kk2vf") pod "f69999cd-9680-4813-b49e-a8e1b9adf2f6" (UID: "f69999cd-9680-4813-b49e-a8e1b9adf2f6"). InnerVolumeSpecName "kube-api-access-kk2vf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:24:11.415386 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.415324    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f69999cd-9680-4813-b49e-a8e1b9adf2f6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f69999cd-9680-4813-b49e-a8e1b9adf2f6" (UID: "f69999cd-9680-4813-b49e-a8e1b9adf2f6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:24:11.513926 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.513892    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f69999cd-9680-4813-b49e-a8e1b9adf2f6-model-cache\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:24:11.513926 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.513919    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f69999cd-9680-4813-b49e-a8e1b9adf2f6-home\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:24:11.513926 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.513931    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f69999cd-9680-4813-b49e-a8e1b9adf2f6-tls-certs\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:24:11.514165 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.513942    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk2vf\" (UniqueName: \"kubernetes.io/projected/f69999cd-9680-4813-b49e-a8e1b9adf2f6-kube-api-access-kk2vf\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:24:11.514165 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.513954    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f69999cd-9680-4813-b49e-a8e1b9adf2f6-tmp-dir\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:24:11.514165 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.513966    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f69999cd-9680-4813-b49e-a8e1b9adf2f6-dshm\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:24:11.983424 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.983391    2583 generic.go:356] "Generic (PLEG): container finished" podID="f69999cd-9680-4813-b49e-a8e1b9adf2f6" containerID="e840e777ebbd86f88dc1c9859e5996c15af9fd198d656100312f4d936bbfbf50" exitCode=0
Jul 22 21:24:11.983618 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.983435    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x" event={"ID":"f69999cd-9680-4813-b49e-a8e1b9adf2f6","Type":"ContainerDied","Data":"e840e777ebbd86f88dc1c9859e5996c15af9fd198d656100312f4d936bbfbf50"}
Jul 22 21:24:11.983618 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.983445    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"
Jul 22 21:24:11.983618 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.983461    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x" event={"ID":"f69999cd-9680-4813-b49e-a8e1b9adf2f6","Type":"ContainerDied","Data":"8cc10072e20e7b4ea8cfd9a79ca0c077390ac22905c2200ebfa2543bd61054ff"}
Jul 22 21:24:11.983618 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.983477    2583 scope.go:117] "RemoveContainer" containerID="e840e777ebbd86f88dc1c9859e5996c15af9fd198d656100312f4d936bbfbf50"
Jul 22 21:24:11.992488 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.992466    2583 scope.go:117] "RemoveContainer" containerID="e840e777ebbd86f88dc1c9859e5996c15af9fd198d656100312f4d936bbfbf50"
Jul 22 21:24:11.992759 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:24:11.992740    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e840e777ebbd86f88dc1c9859e5996c15af9fd198d656100312f4d936bbfbf50\": container with ID starting with e840e777ebbd86f88dc1c9859e5996c15af9fd198d656100312f4d936bbfbf50 not found: ID does not exist" containerID="e840e777ebbd86f88dc1c9859e5996c15af9fd198d656100312f4d936bbfbf50"
Jul 22 21:24:11.992802 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:11.992769    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e840e777ebbd86f88dc1c9859e5996c15af9fd198d656100312f4d936bbfbf50"} err="failed to get container status \"e840e777ebbd86f88dc1c9859e5996c15af9fd198d656100312f4d936bbfbf50\": rpc error: code = NotFound desc = could not find container \"e840e777ebbd86f88dc1c9859e5996c15af9fd198d656100312f4d936bbfbf50\": container with ID starting with e840e777ebbd86f88dc1c9859e5996c15af9fd198d656100312f4d936bbfbf50 not found: ID does not exist"
Jul 22 21:24:12.002809 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.002788    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"]
Jul 22 21:24:12.008380 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.008362    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-6996b4f4-kserve-74cf58b575-w9f5x"]
Jul 22 21:24:12.409758 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.409724    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f69999cd-9680-4813-b49e-a8e1b9adf2f6" path="/var/lib/kubelet/pods/f69999cd-9680-4813-b49e-a8e1b9adf2f6/volumes"
Jul 22 21:24:12.620673 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.620637    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv" podUID="0dd39359-1554-4372-9d75-77f0dc3d3a2f" containerName="main" containerID="cri-o://59735df73bd2c3e4e9c2874720134dc0b15b4c83eb3443293fba9772d35841e3" gracePeriod=45
Jul 22 21:24:12.864252 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.864230    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:24:12.925062 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.925033    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcbzn\" (UniqueName: \"kubernetes.io/projected/0dd39359-1554-4372-9d75-77f0dc3d3a2f-kube-api-access-kcbzn\") pod \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\" (UID: \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\") "
Jul 22 21:24:12.925228 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.925076    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0dd39359-1554-4372-9d75-77f0dc3d3a2f-model-cache\") pod \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\" (UID: \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\") "
Jul 22 21:24:12.925228 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.925098    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dd39359-1554-4372-9d75-77f0dc3d3a2f-tmp-dir\") pod \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\" (UID: \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\") "
Jul 22 21:24:12.925228 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.925149    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0dd39359-1554-4372-9d75-77f0dc3d3a2f-home\") pod \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\" (UID: \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\") "
Jul 22 21:24:12.925228 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.925188    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0dd39359-1554-4372-9d75-77f0dc3d3a2f-tls-certs\") pod \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\" (UID: \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\") "
Jul 22 21:24:12.925228 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.925221    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0dd39359-1554-4372-9d75-77f0dc3d3a2f-dshm\") pod \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\" (UID: \"0dd39359-1554-4372-9d75-77f0dc3d3a2f\") "
Jul 22 21:24:12.925814 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.925353    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd39359-1554-4372-9d75-77f0dc3d3a2f-model-cache" (OuterVolumeSpecName: "model-cache") pod "0dd39359-1554-4372-9d75-77f0dc3d3a2f" (UID: "0dd39359-1554-4372-9d75-77f0dc3d3a2f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:24:12.925814 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.925446    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd39359-1554-4372-9d75-77f0dc3d3a2f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0dd39359-1554-4372-9d75-77f0dc3d3a2f" (UID: "0dd39359-1554-4372-9d75-77f0dc3d3a2f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:24:12.925814 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.925465    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd39359-1554-4372-9d75-77f0dc3d3a2f-home" (OuterVolumeSpecName: "home") pod "0dd39359-1554-4372-9d75-77f0dc3d3a2f" (UID: "0dd39359-1554-4372-9d75-77f0dc3d3a2f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:24:12.925814 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.925551    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dd39359-1554-4372-9d75-77f0dc3d3a2f-tmp-dir\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:24:12.925814 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.925566    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0dd39359-1554-4372-9d75-77f0dc3d3a2f-home\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:24:12.925814 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.925577    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0dd39359-1554-4372-9d75-77f0dc3d3a2f-model-cache\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:24:12.927394 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.927370    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd39359-1554-4372-9d75-77f0dc3d3a2f-dshm" (OuterVolumeSpecName: "dshm") pod "0dd39359-1554-4372-9d75-77f0dc3d3a2f" (UID: "0dd39359-1554-4372-9d75-77f0dc3d3a2f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:24:12.927394 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.927383    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0dd39359-1554-4372-9d75-77f0dc3d3a2f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0dd39359-1554-4372-9d75-77f0dc3d3a2f" (UID: "0dd39359-1554-4372-9d75-77f0dc3d3a2f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:24:12.927494 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.927457    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dd39359-1554-4372-9d75-77f0dc3d3a2f-kube-api-access-kcbzn" (OuterVolumeSpecName: "kube-api-access-kcbzn") pod "0dd39359-1554-4372-9d75-77f0dc3d3a2f" (UID: "0dd39359-1554-4372-9d75-77f0dc3d3a2f"). InnerVolumeSpecName "kube-api-access-kcbzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:24:12.989715 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.989640    2583 generic.go:356] "Generic (PLEG): container finished" podID="0dd39359-1554-4372-9d75-77f0dc3d3a2f" containerID="59735df73bd2c3e4e9c2874720134dc0b15b4c83eb3443293fba9772d35841e3" exitCode=0
Jul 22 21:24:12.989715 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.989685    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"
Jul 22 21:24:12.989893 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.989733    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv" event={"ID":"0dd39359-1554-4372-9d75-77f0dc3d3a2f","Type":"ContainerDied","Data":"59735df73bd2c3e4e9c2874720134dc0b15b4c83eb3443293fba9772d35841e3"}
Jul 22 21:24:12.989893 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.989772    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv" event={"ID":"0dd39359-1554-4372-9d75-77f0dc3d3a2f","Type":"ContainerDied","Data":"37cebb564533ab9d7a013bfe0d758355a68636a16270c9694200c37dfaa90482"}
Jul 22 21:24:12.989893 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.989788    2583 scope.go:117] "RemoveContainer" containerID="59735df73bd2c3e4e9c2874720134dc0b15b4c83eb3443293fba9772d35841e3"
Jul 22 21:24:12.998170 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.998150    2583 scope.go:117] "RemoveContainer" containerID="59735df73bd2c3e4e9c2874720134dc0b15b4c83eb3443293fba9772d35841e3"
Jul 22 21:24:12.998408 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:24:12.998390    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59735df73bd2c3e4e9c2874720134dc0b15b4c83eb3443293fba9772d35841e3\": container with ID starting with 59735df73bd2c3e4e9c2874720134dc0b15b4c83eb3443293fba9772d35841e3 not found: ID does not exist" containerID="59735df73bd2c3e4e9c2874720134dc0b15b4c83eb3443293fba9772d35841e3"
Jul 22 21:24:12.998460 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:12.998416    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59735df73bd2c3e4e9c2874720134dc0b15b4c83eb3443293fba9772d35841e3"} err="failed to get container status \"59735df73bd2c3e4e9c2874720134dc0b15b4c83eb3443293fba9772d35841e3\": rpc error: code = NotFound desc = could not find container \"59735df73bd2c3e4e9c2874720134dc0b15b4c83eb3443293fba9772d35841e3\": container with ID starting with 59735df73bd2c3e4e9c2874720134dc0b15b4c83eb3443293fba9772d35841e3 not found: ID does not exist"
Jul 22 21:24:13.008207 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:13.008184    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"]
Jul 22 21:24:13.010616 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:13.010597    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-6996b4f4-kserve-65b7488875-mwhxv"]
Jul 22 21:24:13.026475 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:13.026452    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0dd39359-1554-4372-9d75-77f0dc3d3a2f-tls-certs\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:24:13.026475 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:13.026470    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0dd39359-1554-4372-9d75-77f0dc3d3a2f-dshm\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:24:13.026596 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:13.026480    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcbzn\" (UniqueName: \"kubernetes.io/projected/0dd39359-1554-4372-9d75-77f0dc3d3a2f-kube-api-access-kcbzn\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:24:14.409796 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:24:14.409764    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dd39359-1554-4372-9d75-77f0dc3d3a2f" path="/var/lib/kubelet/pods/0dd39359-1554-4372-9d75-77f0dc3d3a2f/volumes"
Jul 22 21:27:44.815443 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.815413    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"]
Jul 22 21:27:44.815895 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.815745    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f69999cd-9680-4813-b49e-a8e1b9adf2f6" containerName="main"
Jul 22 21:27:44.815895 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.815756    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f69999cd-9680-4813-b49e-a8e1b9adf2f6" containerName="main"
Jul 22 21:27:44.815895 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.815778    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dd39359-1554-4372-9d75-77f0dc3d3a2f" containerName="main"
Jul 22 21:27:44.815895 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.815785    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dd39359-1554-4372-9d75-77f0dc3d3a2f" containerName="main"
Jul 22 21:27:44.815895 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.815832    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dd39359-1554-4372-9d75-77f0dc3d3a2f" containerName="main"
Jul 22 21:27:44.815895 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.815843    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f69999cd-9680-4813-b49e-a8e1b9adf2f6" containerName="main"
Jul 22 21:27:44.818829 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.818814    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.821311 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.821289    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d4a1f8ee-openshift-default-dockercfg-tgrcv\""
Jul 22 21:27:44.821478 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.821415    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 22 21:27:44.841673 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.841638    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-workload-certs\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.841794 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.841700    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istio-data\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.841794 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.841746    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istio-envoy\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.841794 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.841772    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-workload-socket\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.841922 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.841818    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpw2d\" (UniqueName: \"kubernetes.io/projected/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-kube-api-access-gpw2d\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.841922 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.841903    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-credential-socket\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.842000 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.841947    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istio-podinfo\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.842000 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.841983    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istiod-ca-cert\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.842071 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.842040    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istio-token\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.842298 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.842283    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"]
Jul 22 21:27:44.942592 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.942566    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istio-podinfo\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.942777 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.942607    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istiod-ca-cert\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.942777 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.942654    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istio-token\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.942777 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.942691    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-workload-certs\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.942777 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.942746    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istio-data\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.943000 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.942809    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istio-envoy\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.943000 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.942834    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-workload-socket\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.943000 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.942851    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpw2d\" (UniqueName: \"kubernetes.io/projected/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-kube-api-access-gpw2d\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.943000 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.942904    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-credential-socket\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.943245 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.943216    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istio-data\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.943354 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.943330    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-workload-certs\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.943513 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.943493    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-credential-socket\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.943586 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.943503    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-workload-socket\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.943675 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.943604    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istiod-ca-cert\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.945769 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.945749    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istio-envoy\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.945897 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.945883    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istio-podinfo\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.950915 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.950894    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istio-token\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:44.951485 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:44.951465    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpw2d\" (UniqueName: \"kubernetes.io/projected/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-kube-api-access-gpw2d\") pod \"e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") " pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:45.128377 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:45.128352    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:45.263835 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:45.263806    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"]
Jul 22 21:27:45.265434 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:27:45.265406    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dbafa07_e814_42d7_9d42_aaed8da1f1e7.slice/crio-65a9ba85b5a0d9d5f76ba37c5771381052509d27482c0c92b5a760e786f35f67 WatchSource:0}: Error finding container 65a9ba85b5a0d9d5f76ba37c5771381052509d27482c0c92b5a760e786f35f67: Status 404 returned error can't find the container with id 65a9ba85b5a0d9d5f76ba37c5771381052509d27482c0c92b5a760e786f35f67
Jul 22 21:27:45.267857 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:45.267838    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 21:27:45.905489 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:45.905450    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk" event={"ID":"5dbafa07-e814-42d7-9d42-aaed8da1f1e7","Type":"ContainerStarted","Data":"65a9ba85b5a0d9d5f76ba37c5771381052509d27482c0c92b5a760e786f35f67"}
Jul 22 21:27:48.045306 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:48.045268    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:27:48.045616 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:48.045341    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:27:48.045616 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:48.045371    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:27:48.921035 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:48.920997    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk" event={"ID":"5dbafa07-e814-42d7-9d42-aaed8da1f1e7","Type":"ContainerStarted","Data":"55eabcf3e5429d94c4bc90599be2a5c3d266610f7d196057ff20d548ed94296c"}
Jul 22 21:27:48.947470 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:48.947418    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk" podStartSLOduration=2.170428115 podStartE2EDuration="4.947402713s" totalImagesPullingTime="2.776974598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:27:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:27:48.94623543 +0000 UTC m=+1866.970274010" watchObservedRunningTime="2026-07-22 21:27:48.947402713 +0000 UTC m=+1866.971441292"
Jul 22 21:27:49.129090 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:49.129059    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:49.133721 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:49.133698    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:49.926149 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:49.926096    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:27:49.926982 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:27:49.926960    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:28:02.995007 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:02.994975    2583 generic.go:356] "Generic (PLEG): container finished" podID="5dbafa07-e814-42d7-9d42-aaed8da1f1e7" containerID="55eabcf3e5429d94c4bc90599be2a5c3d266610f7d196057ff20d548ed94296c" exitCode=0
Jul 22 21:28:02.995457 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:02.995014    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk" event={"ID":"5dbafa07-e814-42d7-9d42-aaed8da1f1e7","Type":"ContainerDied","Data":"55eabcf3e5429d94c4bc90599be2a5c3d266610f7d196057ff20d548ed94296c"}
Jul 22 21:28:02.995457 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:02.995337    2583 scope.go:117] "RemoveContainer" containerID="55eabcf3e5429d94c4bc90599be2a5c3d266610f7d196057ff20d548ed94296c"
Jul 22 21:28:02.997164 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:02.997137    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:28:02.997239 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:02.997201    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:28:02.997239 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:02.997230    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:28:04.001464 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:04.001386    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk" event={"ID":"5dbafa07-e814-42d7-9d42-aaed8da1f1e7","Type":"ContainerStarted","Data":"2f079297c9c38bd78c99e0863d28865ee12f11eb38f71a607f6960932b268e51"}
Jul 22 21:28:04.129159 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:04.129125    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:28:04.130138 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:04.130092    2583 patch_prober.go:28] interesting pod/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 22 21:28:04.130258 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:04.130159    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk" podUID="5dbafa07-e814-42d7-9d42-aaed8da1f1e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 22 21:28:04.926954 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:04.926925    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:28:05.128786 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:05.128757    2583 patch_prober.go:28] interesting pod/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 22 21:28:05.129149 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:05.128804    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk" podUID="5dbafa07-e814-42d7-9d42-aaed8da1f1e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 22 21:28:06.129299 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:06.129250    2583 patch_prober.go:28] interesting pod/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 22 21:28:06.129693 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:06.129321    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk" podUID="5dbafa07-e814-42d7-9d42-aaed8da1f1e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 22 21:28:07.129444 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:07.129411    2583 patch_prober.go:28] interesting pod/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 22 21:28:07.129827 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:07.129467    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk" podUID="5dbafa07-e814-42d7-9d42-aaed8da1f1e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 22 21:28:08.132749 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:08.132710    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:28:08.133721 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:08.133683    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:28:31.078984 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:31.078945    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"]
Jul 22 21:28:31.079553 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:31.079185    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk" podUID="5dbafa07-e814-42d7-9d42-aaed8da1f1e7" containerName="istio-proxy" containerID="cri-o://2f079297c9c38bd78c99e0863d28865ee12f11eb38f71a607f6960932b268e51" gracePeriod=30
Jul 22 21:28:32.112536 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.112506    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"]
Jul 22 21:28:32.115815 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.115792    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.118936 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.118918    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-9ab0a8ae-gw-openshift-default-dockercfg-mrqq5\""
Jul 22 21:28:32.130544 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.130522    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"]
Jul 22 21:28:32.234452 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.234427    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-workload-socket\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.234597 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.234469    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-workload-certs\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.234597 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.234494    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istio-data\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.234597 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.234540    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfxgj\" (UniqueName: \"kubernetes.io/projected/c1af6a4e-595e-477d-9dcd-c976c1b552c8-kube-api-access-sfxgj\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.234597 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.234562    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-credential-socket\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.234597 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.234592    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istio-envoy\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.234786 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.234611    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istiod-ca-cert\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.234786 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.234630    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istio-token\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.234786 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.234662    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istio-podinfo\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.335039 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.335003    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-workload-socket\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.335209 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.335056    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-workload-certs\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.335209 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.335082    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istio-data\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.335209 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.335133    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfxgj\" (UniqueName: \"kubernetes.io/projected/c1af6a4e-595e-477d-9dcd-c976c1b552c8-kube-api-access-sfxgj\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.335209 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.335164    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-credential-socket\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.335209 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.335191    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istio-envoy\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.335484 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.335213    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istiod-ca-cert\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.335484 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.335243    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istio-token\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.335484 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.335310    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istio-podinfo\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.335638 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.335508    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-workload-certs\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.335757 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.335725    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-workload-socket\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.336195 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.335688    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-credential-socket\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.336346 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.336288    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istio-data\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.336574 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.336534    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istiod-ca-cert\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.342785 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.339173    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istio-envoy\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.342785 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.339397    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istio-podinfo\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.349659 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.349635    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfxgj\" (UniqueName: \"kubernetes.io/projected/c1af6a4e-595e-477d-9dcd-c976c1b552c8-kube-api-access-sfxgj\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.352422 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.352403    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istio-token\") pod \"e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") " pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.426539 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.426484    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:32.561391 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.561366    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"]
Jul 22 21:28:32.562532 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:28:32.562506    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1af6a4e_595e_477d_9dcd_c976c1b552c8.slice/crio-8c2d049072d1b2cf90bd7bc90038e3c3ea53768e57f9eea9e7fd229af217845f WatchSource:0}: Error finding container 8c2d049072d1b2cf90bd7bc90038e3c3ea53768e57f9eea9e7fd229af217845f: Status 404 returned error can't find the container with id 8c2d049072d1b2cf90bd7bc90038e3c3ea53768e57f9eea9e7fd229af217845f
Jul 22 21:28:32.564562 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.564532    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:28:32.564629 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.564615    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:28:32.564672 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:32.564646    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:28:33.131168 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:33.131136    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb" event={"ID":"c1af6a4e-595e-477d-9dcd-c976c1b552c8","Type":"ContainerStarted","Data":"9f46e481efeb34ae25d919197da7e4eaa750a7340940589971b2caecca135ea4"}
Jul 22 21:28:33.131532 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:33.131186    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb" event={"ID":"c1af6a4e-595e-477d-9dcd-c976c1b552c8","Type":"ContainerStarted","Data":"8c2d049072d1b2cf90bd7bc90038e3c3ea53768e57f9eea9e7fd229af217845f"}
Jul 22 21:28:33.152095 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:33.152047    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb" podStartSLOduration=1.15203293 podStartE2EDuration="1.15203293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:28:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:28:33.149820914 +0000 UTC m=+1911.173859494" watchObservedRunningTime="2026-07-22 21:28:33.15203293 +0000 UTC m=+1911.176071592"
Jul 22 21:28:33.427057 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:33.426980    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:33.431503 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:33.431476    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:34.136333 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:34.136298    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:34.137229 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:34.137205    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:36.313421 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.313398    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:28:36.369037 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.369015    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-workload-socket\") pod \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") "
Jul 22 21:28:36.369186 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.369054    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istio-token\") pod \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") "
Jul 22 21:28:36.369186 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.369087    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istio-data\") pod \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") "
Jul 22 21:28:36.369186 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.369140    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istio-podinfo\") pod \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") "
Jul 22 21:28:36.369318 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.369203    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpw2d\" (UniqueName: \"kubernetes.io/projected/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-kube-api-access-gpw2d\") pod \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") "
Jul 22 21:28:36.369318 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.369241    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-credential-socket\") pod \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") "
Jul 22 21:28:36.369318 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.369275    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istiod-ca-cert\") pod \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") "
Jul 22 21:28:36.369318 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.369293    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5dbafa07-e814-42d7-9d42-aaed8da1f1e7" (UID: "5dbafa07-e814-42d7-9d42-aaed8da1f1e7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:28:36.369518 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.369320    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istio-envoy\") pod \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") "
Jul 22 21:28:36.369518 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.369354    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-workload-certs\") pod \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\" (UID: \"5dbafa07-e814-42d7-9d42-aaed8da1f1e7\") "
Jul 22 21:28:36.369614 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.369524    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5dbafa07-e814-42d7-9d42-aaed8da1f1e7" (UID: "5dbafa07-e814-42d7-9d42-aaed8da1f1e7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:28:36.369614 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.369553    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5dbafa07-e814-42d7-9d42-aaed8da1f1e7" (UID: "5dbafa07-e814-42d7-9d42-aaed8da1f1e7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:28:36.369741 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.369677    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-workload-socket\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:28:36.369741 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.369695    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-credential-socket\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:28:36.369741 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.369718    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istiod-ca-cert\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:28:36.369741 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.369716    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5dbafa07-e814-42d7-9d42-aaed8da1f1e7" (UID: "5dbafa07-e814-42d7-9d42-aaed8da1f1e7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:28:36.370188 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.370163    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istio-data" (OuterVolumeSpecName: "istio-data") pod "5dbafa07-e814-42d7-9d42-aaed8da1f1e7" (UID: "5dbafa07-e814-42d7-9d42-aaed8da1f1e7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:28:36.371623 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.371600    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5dbafa07-e814-42d7-9d42-aaed8da1f1e7" (UID: "5dbafa07-e814-42d7-9d42-aaed8da1f1e7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 21:28:36.371719 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.371673    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istio-token" (OuterVolumeSpecName: "istio-token") pod "5dbafa07-e814-42d7-9d42-aaed8da1f1e7" (UID: "5dbafa07-e814-42d7-9d42-aaed8da1f1e7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:28:36.371719 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.371683    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-kube-api-access-gpw2d" (OuterVolumeSpecName: "kube-api-access-gpw2d") pod "5dbafa07-e814-42d7-9d42-aaed8da1f1e7" (UID: "5dbafa07-e814-42d7-9d42-aaed8da1f1e7"). InnerVolumeSpecName "kube-api-access-gpw2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:28:36.371819 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.371754    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5dbafa07-e814-42d7-9d42-aaed8da1f1e7" (UID: "5dbafa07-e814-42d7-9d42-aaed8da1f1e7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:28:36.470399 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.470362    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpw2d\" (UniqueName: \"kubernetes.io/projected/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-kube-api-access-gpw2d\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:28:36.470399 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.470398    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istio-envoy\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:28:36.470399 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.470408    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-workload-certs\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:28:36.470573 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.470416    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istio-token\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:28:36.470573 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.470424    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istio-data\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:28:36.470573 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:36.470431    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dbafa07-e814-42d7-9d42-aaed8da1f1e7-istio-podinfo\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:28:37.159387 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:37.159352    2583 generic.go:356] "Generic (PLEG): container finished" podID="5dbafa07-e814-42d7-9d42-aaed8da1f1e7" containerID="2f079297c9c38bd78c99e0863d28865ee12f11eb38f71a607f6960932b268e51" exitCode=0
Jul 22 21:28:37.159558 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:37.159418    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"
Jul 22 21:28:37.159558 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:37.159428    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk" event={"ID":"5dbafa07-e814-42d7-9d42-aaed8da1f1e7","Type":"ContainerDied","Data":"2f079297c9c38bd78c99e0863d28865ee12f11eb38f71a607f6960932b268e51"}
Jul 22 21:28:37.159558 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:37.159500    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk" event={"ID":"5dbafa07-e814-42d7-9d42-aaed8da1f1e7","Type":"ContainerDied","Data":"65a9ba85b5a0d9d5f76ba37c5771381052509d27482c0c92b5a760e786f35f67"}
Jul 22 21:28:37.159558 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:37.159523    2583 scope.go:117] "RemoveContainer" containerID="2f079297c9c38bd78c99e0863d28865ee12f11eb38f71a607f6960932b268e51"
Jul 22 21:28:37.169411 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:37.169383    2583 scope.go:117] "RemoveContainer" containerID="55eabcf3e5429d94c4bc90599be2a5c3d266610f7d196057ff20d548ed94296c"
Jul 22 21:28:37.180283 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:37.180255    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"]
Jul 22 21:28:37.181865 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:37.181840    2583 scope.go:117] "RemoveContainer" containerID="2f079297c9c38bd78c99e0863d28865ee12f11eb38f71a607f6960932b268e51"
Jul 22 21:28:37.182237 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:28:37.182215    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f079297c9c38bd78c99e0863d28865ee12f11eb38f71a607f6960932b268e51\": container with ID starting with 2f079297c9c38bd78c99e0863d28865ee12f11eb38f71a607f6960932b268e51 not found: ID does not exist" containerID="2f079297c9c38bd78c99e0863d28865ee12f11eb38f71a607f6960932b268e51"
Jul 22 21:28:37.182305 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:37.182246    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f079297c9c38bd78c99e0863d28865ee12f11eb38f71a607f6960932b268e51"} err="failed to get container status \"2f079297c9c38bd78c99e0863d28865ee12f11eb38f71a607f6960932b268e51\": rpc error: code = NotFound desc = could not find container \"2f079297c9c38bd78c99e0863d28865ee12f11eb38f71a607f6960932b268e51\": container with ID starting with 2f079297c9c38bd78c99e0863d28865ee12f11eb38f71a607f6960932b268e51 not found: ID does not exist"
Jul 22 21:28:37.182305 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:37.182266    2583 scope.go:117] "RemoveContainer" containerID="55eabcf3e5429d94c4bc90599be2a5c3d266610f7d196057ff20d548ed94296c"
Jul 22 21:28:37.182567 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:28:37.182542    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55eabcf3e5429d94c4bc90599be2a5c3d266610f7d196057ff20d548ed94296c\": container with ID starting with 55eabcf3e5429d94c4bc90599be2a5c3d266610f7d196057ff20d548ed94296c not found: ID does not exist" containerID="55eabcf3e5429d94c4bc90599be2a5c3d266610f7d196057ff20d548ed94296c"
Jul 22 21:28:37.182618 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:37.182578    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55eabcf3e5429d94c4bc90599be2a5c3d266610f7d196057ff20d548ed94296c"} err="failed to get container status \"55eabcf3e5429d94c4bc90599be2a5c3d266610f7d196057ff20d548ed94296c\": rpc error: code = NotFound desc = could not find container \"55eabcf3e5429d94c4bc90599be2a5c3d266610f7d196057ff20d548ed94296c\": container with ID starting with 55eabcf3e5429d94c4bc90599be2a5c3d266610f7d196057ff20d548ed94296c not found: ID does not exist"
Jul 22 21:28:37.183967 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:37.183946    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d4a1f8ee-openshift-default-576db4cff9-5v2nk"]
Jul 22 21:28:38.409806 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:38.409764    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dbafa07-e814-42d7-9d42-aaed8da1f1e7" path="/var/lib/kubelet/pods/5dbafa07-e814-42d7-9d42-aaed8da1f1e7/volumes"
Jul 22 21:28:48.210891 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:48.210859    2583 generic.go:356] "Generic (PLEG): container finished" podID="c1af6a4e-595e-477d-9dcd-c976c1b552c8" containerID="9f46e481efeb34ae25d919197da7e4eaa750a7340940589971b2caecca135ea4" exitCode=0
Jul 22 21:28:48.211319 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:48.210929    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb" event={"ID":"c1af6a4e-595e-477d-9dcd-c976c1b552c8","Type":"ContainerDied","Data":"9f46e481efeb34ae25d919197da7e4eaa750a7340940589971b2caecca135ea4"}
Jul 22 21:28:48.211422 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:48.211404    2583 scope.go:117] "RemoveContainer" containerID="9f46e481efeb34ae25d919197da7e4eaa750a7340940589971b2caecca135ea4"
Jul 22 21:28:48.212462 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:48.212431    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:28:48.212569 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:48.212516    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:28:48.212569 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:48.212562    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:28:49.136236 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:49.136201    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:49.216678 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:49.216643    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb" event={"ID":"c1af6a4e-595e-477d-9dcd-c976c1b552c8","Type":"ContainerStarted","Data":"69546a46af33420e0be59cedd9248c448ef15a07137726fe56d67d91b045d669"}
Jul 22 21:28:49.427734 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:49.427645    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:49.428978 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:49.428950    2583 patch_prober.go:28] interesting pod/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 22 21:28:49.429100 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:49.429015    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb" podUID="c1af6a4e-595e-477d-9dcd-c976c1b552c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 22 21:28:50.427120 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:50.427076    2583 patch_prober.go:28] interesting pod/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 22 21:28:50.427515 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:50.427141    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb" podUID="c1af6a4e-595e-477d-9dcd-c976c1b552c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 22 21:28:51.427575 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:51.427541    2583 patch_prober.go:28] interesting pod/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 22 21:28:51.427958 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:51.427596    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb" podUID="c1af6a4e-595e-477d-9dcd-c976c1b552c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 22 21:28:52.427263 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:52.427224    2583 patch_prober.go:28] interesting pod/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 22 21:28:52.427464 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:52.427282    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb" podUID="c1af6a4e-595e-477d-9dcd-c976c1b552c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 22 21:28:53.431077 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:53.431044    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:53.431559 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:53.431429    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:28:53.432127 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:28:53.432094    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:29:14.825359 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:14.825317    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"]
Jul 22 21:29:14.825916 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:14.825568    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb" podUID="c1af6a4e-595e-477d-9dcd-c976c1b552c8" containerName="istio-proxy" containerID="cri-o://69546a46af33420e0be59cedd9248c448ef15a07137726fe56d67d91b045d669" gracePeriod=30
Jul 22 21:29:15.594643 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.594608    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"]
Jul 22 21:29:15.594937 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.594925    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dbafa07-e814-42d7-9d42-aaed8da1f1e7" containerName="istio-proxy"
Jul 22 21:29:15.594981 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.594938    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dbafa07-e814-42d7-9d42-aaed8da1f1e7" containerName="istio-proxy"
Jul 22 21:29:15.594981 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.594950    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dbafa07-e814-42d7-9d42-aaed8da1f1e7" containerName="istio-proxy"
Jul 22 21:29:15.594981 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.594955    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dbafa07-e814-42d7-9d42-aaed8da1f1e7" containerName="istio-proxy"
Jul 22 21:29:15.595083 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.595007    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dbafa07-e814-42d7-9d42-aaed8da1f1e7" containerName="istio-proxy"
Jul 22 21:29:15.595083 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.595020    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dbafa07-e814-42d7-9d42-aaed8da1f1e7" containerName="istio-proxy"
Jul 22 21:29:15.597906 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.597889    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.600078 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.600057    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1f4291a2-openshift-default-dockercfg-25xw5\""
Jul 22 21:29:15.611086 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.611065    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"]
Jul 22 21:29:15.693222 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.693197    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istiod-ca-cert\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.693344 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.693234    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-workload-socket\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.693344 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.693259    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsvf8\" (UniqueName: \"kubernetes.io/projected/67ecb85a-02a1-4942-83d1-0e0e3cf83785-kube-api-access-rsvf8\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.693423 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.693381    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-credential-socket\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.693492 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.693419    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istio-podinfo\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.693492 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.693450    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istio-data\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.693569 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.693504    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istio-token\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.693569 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.693545    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-workload-certs\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.693643 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.693625    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istio-envoy\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.794283 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.794255    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-workload-certs\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.794405 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.794332    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istio-envoy\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.794405 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.794360    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istiod-ca-cert\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.794405 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.794386    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-workload-socket\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.794580 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.794509    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsvf8\" (UniqueName: \"kubernetes.io/projected/67ecb85a-02a1-4942-83d1-0e0e3cf83785-kube-api-access-rsvf8\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.794580 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.794561    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-credential-socket\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.794688 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.794584    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istio-podinfo\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.794688 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.794659    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-workload-certs\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.794800 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.794697    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istio-data\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.794800 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.794740    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istio-token\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.794800 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.794747    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-workload-socket\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.794993 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.794965    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-credential-socket\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.795064 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.795023    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istio-data\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.795197 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.795178    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istiod-ca-cert\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.796739 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.796716    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istio-envoy\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.797081 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.797061    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istio-podinfo\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.802542 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.802521    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istio-token\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.802623 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.802538    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsvf8\" (UniqueName: \"kubernetes.io/projected/67ecb85a-02a1-4942-83d1-0e0e3cf83785-kube-api-access-rsvf8\") pod \"e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") " pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:15.908461 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:15.908402    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:16.052177 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:16.047819    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"]
Jul 22 21:29:16.053941 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:16.053897    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:29:16.054047 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:16.054002    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:29:16.054047 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:16.054042    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:29:16.340567 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:16.340483    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw" event={"ID":"67ecb85a-02a1-4942-83d1-0e0e3cf83785","Type":"ContainerStarted","Data":"900d42c12633996a07e93034d71a87a23052e882879d705e072d0ad4c5239c8e"}
Jul 22 21:29:16.340567 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:16.340552    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw" event={"ID":"67ecb85a-02a1-4942-83d1-0e0e3cf83785","Type":"ContainerStarted","Data":"1593273f60c5bc42597c30a5b8b0e63e0012d4e3061f861c09706afd33539cf5"}
Jul 22 21:29:16.371176 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:16.371138    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw" podStartSLOduration=1.371124767 podStartE2EDuration="1.371124767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:29:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:29:16.371036794 +0000 UTC m=+1954.395075373" watchObservedRunningTime="2026-07-22 21:29:16.371124767 +0000 UTC m=+1954.395163337"
Jul 22 21:29:16.908881 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:16.908851    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:17.914188 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:17.914160    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:18.349167 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:18.349143    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:18.350327 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:18.350307    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:20.066840 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.066815    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:29:20.234362 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.234282    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istiod-ca-cert\") pod \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") "
Jul 22 21:29:20.234362 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.234325    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istio-data\") pod \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") "
Jul 22 21:29:20.234362 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.234355    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-workload-certs\") pod \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") "
Jul 22 21:29:20.234598 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.234403    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfxgj\" (UniqueName: \"kubernetes.io/projected/c1af6a4e-595e-477d-9dcd-c976c1b552c8-kube-api-access-sfxgj\") pod \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") "
Jul 22 21:29:20.234598 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.234431    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istio-envoy\") pod \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") "
Jul 22 21:29:20.234598 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.234486    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-credential-socket\") pod \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") "
Jul 22 21:29:20.234598 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.234515    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istio-podinfo\") pod \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") "
Jul 22 21:29:20.234806 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.234738    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c1af6a4e-595e-477d-9dcd-c976c1b552c8" (UID: "c1af6a4e-595e-477d-9dcd-c976c1b552c8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:29:20.234806 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.234747    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c1af6a4e-595e-477d-9dcd-c976c1b552c8" (UID: "c1af6a4e-595e-477d-9dcd-c976c1b552c8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:29:20.234806 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.234755    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c1af6a4e-595e-477d-9dcd-c976c1b552c8" (UID: "c1af6a4e-595e-477d-9dcd-c976c1b552c8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:29:20.234934 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.234830    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istio-token\") pod \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") "
Jul 22 21:29:20.234934 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.234882    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-workload-socket\") pod \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\" (UID: \"c1af6a4e-595e-477d-9dcd-c976c1b552c8\") "
Jul 22 21:29:20.235268 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.235174    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c1af6a4e-595e-477d-9dcd-c976c1b552c8" (UID: "c1af6a4e-595e-477d-9dcd-c976c1b552c8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:29:20.235268 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.235227    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-workload-certs\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:29:20.235268 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.235247    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-credential-socket\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:29:20.235268 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.235261    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istiod-ca-cert\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:29:20.235489 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.235338    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istio-data" (OuterVolumeSpecName: "istio-data") pod "c1af6a4e-595e-477d-9dcd-c976c1b552c8" (UID: "c1af6a4e-595e-477d-9dcd-c976c1b552c8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:29:20.236829 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.236794    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c1af6a4e-595e-477d-9dcd-c976c1b552c8" (UID: "c1af6a4e-595e-477d-9dcd-c976c1b552c8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:29:20.236974 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.236954    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istio-token" (OuterVolumeSpecName: "istio-token") pod "c1af6a4e-595e-477d-9dcd-c976c1b552c8" (UID: "c1af6a4e-595e-477d-9dcd-c976c1b552c8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:29:20.237212 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.237193    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c1af6a4e-595e-477d-9dcd-c976c1b552c8" (UID: "c1af6a4e-595e-477d-9dcd-c976c1b552c8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 21:29:20.237268 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.237212    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1af6a4e-595e-477d-9dcd-c976c1b552c8-kube-api-access-sfxgj" (OuterVolumeSpecName: "kube-api-access-sfxgj") pod "c1af6a4e-595e-477d-9dcd-c976c1b552c8" (UID: "c1af6a4e-595e-477d-9dcd-c976c1b552c8"). InnerVolumeSpecName "kube-api-access-sfxgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:29:20.336569 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.336541    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istio-token\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:29:20.336569 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.336567    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-workload-socket\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:29:20.336723 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.336576    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istio-data\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:29:20.336723 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.336585    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfxgj\" (UniqueName: \"kubernetes.io/projected/c1af6a4e-595e-477d-9dcd-c976c1b552c8-kube-api-access-sfxgj\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:29:20.336723 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.336593    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istio-envoy\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:29:20.336723 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.336602    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1af6a4e-595e-477d-9dcd-c976c1b552c8-istio-podinfo\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:29:20.358823 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.358787    2583 generic.go:356] "Generic (PLEG): container finished" podID="c1af6a4e-595e-477d-9dcd-c976c1b552c8" containerID="69546a46af33420e0be59cedd9248c448ef15a07137726fe56d67d91b045d669" exitCode=0
Jul 22 21:29:20.358950 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.358843    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"
Jul 22 21:29:20.358950 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.358875    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb" event={"ID":"c1af6a4e-595e-477d-9dcd-c976c1b552c8","Type":"ContainerDied","Data":"69546a46af33420e0be59cedd9248c448ef15a07137726fe56d67d91b045d669"}
Jul 22 21:29:20.358950 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.358942    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb" event={"ID":"c1af6a4e-595e-477d-9dcd-c976c1b552c8","Type":"ContainerDied","Data":"8c2d049072d1b2cf90bd7bc90038e3c3ea53768e57f9eea9e7fd229af217845f"}
Jul 22 21:29:20.359160 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.358975    2583 scope.go:117] "RemoveContainer" containerID="69546a46af33420e0be59cedd9248c448ef15a07137726fe56d67d91b045d669"
Jul 22 21:29:20.368189 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.368150    2583 scope.go:117] "RemoveContainer" containerID="9f46e481efeb34ae25d919197da7e4eaa750a7340940589971b2caecca135ea4"
Jul 22 21:29:20.381175 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.381149    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"]
Jul 22 21:29:20.381257 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.381237    2583 scope.go:117] "RemoveContainer" containerID="69546a46af33420e0be59cedd9248c448ef15a07137726fe56d67d91b045d669"
Jul 22 21:29:20.381547 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:29:20.381529    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69546a46af33420e0be59cedd9248c448ef15a07137726fe56d67d91b045d669\": container with ID starting with 69546a46af33420e0be59cedd9248c448ef15a07137726fe56d67d91b045d669 not found: ID does not exist" containerID="69546a46af33420e0be59cedd9248c448ef15a07137726fe56d67d91b045d669"
Jul 22 21:29:20.381598 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.381556    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69546a46af33420e0be59cedd9248c448ef15a07137726fe56d67d91b045d669"} err="failed to get container status \"69546a46af33420e0be59cedd9248c448ef15a07137726fe56d67d91b045d669\": rpc error: code = NotFound desc = could not find container \"69546a46af33420e0be59cedd9248c448ef15a07137726fe56d67d91b045d669\": container with ID starting with 69546a46af33420e0be59cedd9248c448ef15a07137726fe56d67d91b045d669 not found: ID does not exist"
Jul 22 21:29:20.381598 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.381573    2583 scope.go:117] "RemoveContainer" containerID="9f46e481efeb34ae25d919197da7e4eaa750a7340940589971b2caecca135ea4"
Jul 22 21:29:20.381858 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:29:20.381831    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f46e481efeb34ae25d919197da7e4eaa750a7340940589971b2caecca135ea4\": container with ID starting with 9f46e481efeb34ae25d919197da7e4eaa750a7340940589971b2caecca135ea4 not found: ID does not exist" containerID="9f46e481efeb34ae25d919197da7e4eaa750a7340940589971b2caecca135ea4"
Jul 22 21:29:20.381958 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.381866    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f46e481efeb34ae25d919197da7e4eaa750a7340940589971b2caecca135ea4"} err="failed to get container status \"9f46e481efeb34ae25d919197da7e4eaa750a7340940589971b2caecca135ea4\": rpc error: code = NotFound desc = could not find container \"9f46e481efeb34ae25d919197da7e4eaa750a7340940589971b2caecca135ea4\": container with ID starting with 9f46e481efeb34ae25d919197da7e4eaa750a7340940589971b2caecca135ea4 not found: ID does not exist"
Jul 22 21:29:20.385250 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.385229    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-9ab0a8ae-gw-openshift-default-7d84fcf8ff-6whzb"]
Jul 22 21:29:20.408874 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:20.408854    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1af6a4e-595e-477d-9dcd-c976c1b552c8" path="/var/lib/kubelet/pods/c1af6a4e-595e-477d-9dcd-c976c1b552c8/volumes"
Jul 22 21:29:32.415489 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:32.415445    2583 generic.go:356] "Generic (PLEG): container finished" podID="67ecb85a-02a1-4942-83d1-0e0e3cf83785" containerID="900d42c12633996a07e93034d71a87a23052e882879d705e072d0ad4c5239c8e" exitCode=0
Jul 22 21:29:32.416088 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:32.415520    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw" event={"ID":"67ecb85a-02a1-4942-83d1-0e0e3cf83785","Type":"ContainerDied","Data":"900d42c12633996a07e93034d71a87a23052e882879d705e072d0ad4c5239c8e"}
Jul 22 21:29:32.416088 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:32.416039    2583 scope.go:117] "RemoveContainer" containerID="900d42c12633996a07e93034d71a87a23052e882879d705e072d0ad4c5239c8e"
Jul 22 21:29:32.417240 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:32.417204    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:29:32.417373 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:32.417288    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:29:32.417373 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:32.417320    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:29:33.349061 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:33.349023    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:33.421661 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:33.421581    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw" event={"ID":"67ecb85a-02a1-4942-83d1-0e0e3cf83785","Type":"ContainerStarted","Data":"342200c8ad3cb1d4f40ab7e626d12510c01ad8c8e48d4289ca62a0ea6da4769b"}
Jul 22 21:29:33.909668 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:33.909632    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:33.910743 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:33.910720    2583 patch_prober.go:28] interesting pod/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Jul 22 21:29:33.910863 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:33.910776    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw" podUID="67ecb85a-02a1-4942-83d1-0e0e3cf83785" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Jul 22 21:29:34.909635 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:34.909600    2583 patch_prober.go:28] interesting pod/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Jul 22 21:29:34.910027 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:34.909657    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw" podUID="67ecb85a-02a1-4942-83d1-0e0e3cf83785" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Jul 22 21:29:35.909456 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:35.909420    2583 patch_prober.go:28] interesting pod/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Jul 22 21:29:35.909632 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:35.909472    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw" podUID="67ecb85a-02a1-4942-83d1-0e0e3cf83785" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Jul 22 21:29:36.909152 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:36.909090    2583 patch_prober.go:28] interesting pod/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Jul 22 21:29:36.909643 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:36.909173    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw" podUID="67ecb85a-02a1-4942-83d1-0e0e3cf83785" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Jul 22 21:29:37.913328 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:37.913295    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:37.913790 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:37.913576    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:37.914194 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:37.914176    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:29:59.784386 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:59.784349    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"]
Jul 22 21:29:59.784863 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:29:59.784605    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw" podUID="67ecb85a-02a1-4942-83d1-0e0e3cf83785" containerName="istio-proxy" containerID="cri-o://342200c8ad3cb1d4f40ab7e626d12510c01ad8c8e48d4289ca62a0ea6da4769b" gracePeriod=30
Jul 22 21:30:00.542940 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.542905    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"]
Jul 22 21:30:00.543257 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.543243    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1af6a4e-595e-477d-9dcd-c976c1b552c8" containerName="istio-proxy"
Jul 22 21:30:00.543306 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.543258    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1af6a4e-595e-477d-9dcd-c976c1b552c8" containerName="istio-proxy"
Jul 22 21:30:00.543306 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.543276    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1af6a4e-595e-477d-9dcd-c976c1b552c8" containerName="istio-proxy"
Jul 22 21:30:00.543306 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.543281    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1af6a4e-595e-477d-9dcd-c976c1b552c8" containerName="istio-proxy"
Jul 22 21:30:00.543399 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.543334    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1af6a4e-595e-477d-9dcd-c976c1b552c8" containerName="istio-proxy"
Jul 22 21:30:00.546385 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.546368    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.548847 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.548824    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-a5095382-openshift-default-dockercfg-x8bpp\""
Jul 22 21:30:00.559152 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.559041    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"]
Jul 22 21:30:00.684278 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.684240    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istiod-ca-cert\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.684278 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.684280    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istio-data\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.684485 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.684298    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istio-token\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.684485 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.684363    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-workload-socket\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.684485 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.684404    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-credential-socket\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.684485 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.684435    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cgxr\" (UniqueName: \"kubernetes.io/projected/2baafa89-9812-4bfa-83cc-79a7e2753a9b-kube-api-access-2cgxr\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.684612 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.684496    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istio-podinfo\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.684612 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.684521    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istio-envoy\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.684612 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.684541    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-workload-certs\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.785338 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.785306    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istiod-ca-cert\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.785778 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.785347    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istio-data\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.785778 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.785371    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istio-token\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.785778 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.785406    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-workload-socket\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.785778 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.785434    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-credential-socket\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.785778 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.785469    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cgxr\" (UniqueName: \"kubernetes.io/projected/2baafa89-9812-4bfa-83cc-79a7e2753a9b-kube-api-access-2cgxr\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.785778 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.785511    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istio-podinfo\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.785778 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.785541    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istio-envoy\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.785778 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.785568    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-workload-certs\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.785778 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.785768    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istio-data\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.786201 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.785873    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-workload-socket\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.786201 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.785893    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-credential-socket\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.786201 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.785949    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-workload-certs\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.786201 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.786091    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istiod-ca-cert\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.787965 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.787944    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istio-envoy\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.788222 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.788206    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istio-podinfo\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.793060 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.793011    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istio-token\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.793264 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.793242    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cgxr\" (UniqueName: \"kubernetes.io/projected/2baafa89-9812-4bfa-83cc-79a7e2753a9b-kube-api-access-2cgxr\") pod \"e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") " pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.859546 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.859523    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:00.991683 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.991656    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"]
Jul 22 21:30:00.993310 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:30:00.993284    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2baafa89_9812_4bfa_83cc_79a7e2753a9b.slice/crio-33b1405a8316caf8fca509b01cd3bdfb5f0b455f31ffef98a1263004391a257b WatchSource:0}: Error finding container 33b1405a8316caf8fca509b01cd3bdfb5f0b455f31ffef98a1263004391a257b: Status 404 returned error can't find the container with id 33b1405a8316caf8fca509b01cd3bdfb5f0b455f31ffef98a1263004391a257b
Jul 22 21:30:00.995558 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.995529    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:30:00.995620 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.995589    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:30:00.995662 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:00.995618    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:30:01.542056 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:01.542018    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn" event={"ID":"2baafa89-9812-4bfa-83cc-79a7e2753a9b","Type":"ContainerStarted","Data":"e12d0731523a61a6ce65d085721b01fd56cb3f43a21aa72ffce0a8a03895003a"}
Jul 22 21:30:01.542282 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:01.542080    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn" event={"ID":"2baafa89-9812-4bfa-83cc-79a7e2753a9b","Type":"ContainerStarted","Data":"33b1405a8316caf8fca509b01cd3bdfb5f0b455f31ffef98a1263004391a257b"}
Jul 22 21:30:01.562707 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:01.562653    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn" podStartSLOduration=1.562638703 podStartE2EDuration="1.562638703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:30:01.561735457 +0000 UTC m=+1999.585774035" watchObservedRunningTime="2026-07-22 21:30:01.562638703 +0000 UTC m=+1999.586677282"
Jul 22 21:30:01.860280 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:01.860247    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:02.864718 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:02.864690    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:03.550786 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:03.550751    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:03.551803 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:03.551783    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:05.021554 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.021529    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:30:05.123581 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.123558    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-workload-certs\") pod \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") "
Jul 22 21:30:05.123747 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.123606    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-workload-socket\") pod \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") "
Jul 22 21:30:05.123747 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.123632    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istio-data\") pod \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") "
Jul 22 21:30:05.123747 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.123667    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-credential-socket\") pod \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") "
Jul 22 21:30:05.123747 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.123699    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istio-podinfo\") pod \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") "
Jul 22 21:30:05.123968 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.123758    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istiod-ca-cert\") pod \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") "
Jul 22 21:30:05.123968 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.123779    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsvf8\" (UniqueName: \"kubernetes.io/projected/67ecb85a-02a1-4942-83d1-0e0e3cf83785-kube-api-access-rsvf8\") pod \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") "
Jul 22 21:30:05.123968 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.123809    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istio-token\") pod \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") "
Jul 22 21:30:05.123968 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.123836    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istio-envoy\") pod \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\" (UID: \"67ecb85a-02a1-4942-83d1-0e0e3cf83785\") "
Jul 22 21:30:05.123968 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.123847    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "67ecb85a-02a1-4942-83d1-0e0e3cf83785" (UID: "67ecb85a-02a1-4942-83d1-0e0e3cf83785"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:30:05.123968 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.123885    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "67ecb85a-02a1-4942-83d1-0e0e3cf83785" (UID: "67ecb85a-02a1-4942-83d1-0e0e3cf83785"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:30:05.124354 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.124098    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-workload-certs\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:30:05.124354 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.124136    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-workload-socket\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:30:05.124354 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.124220    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "67ecb85a-02a1-4942-83d1-0e0e3cf83785" (UID: "67ecb85a-02a1-4942-83d1-0e0e3cf83785"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:30:05.124759 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.124728    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "67ecb85a-02a1-4942-83d1-0e0e3cf83785" (UID: "67ecb85a-02a1-4942-83d1-0e0e3cf83785"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:30:05.125091 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.125063    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istio-data" (OuterVolumeSpecName: "istio-data") pod "67ecb85a-02a1-4942-83d1-0e0e3cf83785" (UID: "67ecb85a-02a1-4942-83d1-0e0e3cf83785"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:30:05.126154 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.126119    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "67ecb85a-02a1-4942-83d1-0e0e3cf83785" (UID: "67ecb85a-02a1-4942-83d1-0e0e3cf83785"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 21:30:05.126320 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.126290    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "67ecb85a-02a1-4942-83d1-0e0e3cf83785" (UID: "67ecb85a-02a1-4942-83d1-0e0e3cf83785"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:30:05.126617 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.126584    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istio-token" (OuterVolumeSpecName: "istio-token") pod "67ecb85a-02a1-4942-83d1-0e0e3cf83785" (UID: "67ecb85a-02a1-4942-83d1-0e0e3cf83785"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:30:05.126617 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.126598    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67ecb85a-02a1-4942-83d1-0e0e3cf83785-kube-api-access-rsvf8" (OuterVolumeSpecName: "kube-api-access-rsvf8") pod "67ecb85a-02a1-4942-83d1-0e0e3cf83785" (UID: "67ecb85a-02a1-4942-83d1-0e0e3cf83785"). InnerVolumeSpecName "kube-api-access-rsvf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:30:05.225022 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.225002    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istio-data\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:30:05.225022 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.225023    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-credential-socket\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:30:05.225181 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.225033    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istio-podinfo\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:30:05.225181 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.225041    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istiod-ca-cert\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:30:05.225181 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.225051    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsvf8\" (UniqueName: \"kubernetes.io/projected/67ecb85a-02a1-4942-83d1-0e0e3cf83785-kube-api-access-rsvf8\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:30:05.225181 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.225060    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istio-token\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:30:05.225181 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.225068    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67ecb85a-02a1-4942-83d1-0e0e3cf83785-istio-envoy\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:30:05.562056 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.561985    2583 generic.go:356] "Generic (PLEG): container finished" podID="67ecb85a-02a1-4942-83d1-0e0e3cf83785" containerID="342200c8ad3cb1d4f40ab7e626d12510c01ad8c8e48d4289ca62a0ea6da4769b" exitCode=0
Jul 22 21:30:05.562056 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.562045    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"
Jul 22 21:30:05.562217 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.562081    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw" event={"ID":"67ecb85a-02a1-4942-83d1-0e0e3cf83785","Type":"ContainerDied","Data":"342200c8ad3cb1d4f40ab7e626d12510c01ad8c8e48d4289ca62a0ea6da4769b"}
Jul 22 21:30:05.562217 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.562151    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw" event={"ID":"67ecb85a-02a1-4942-83d1-0e0e3cf83785","Type":"ContainerDied","Data":"1593273f60c5bc42597c30a5b8b0e63e0012d4e3061f861c09706afd33539cf5"}
Jul 22 21:30:05.562217 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.562178    2583 scope.go:117] "RemoveContainer" containerID="342200c8ad3cb1d4f40ab7e626d12510c01ad8c8e48d4289ca62a0ea6da4769b"
Jul 22 21:30:05.578581 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.578559    2583 scope.go:117] "RemoveContainer" containerID="900d42c12633996a07e93034d71a87a23052e882879d705e072d0ad4c5239c8e"
Jul 22 21:30:05.586906 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.586887    2583 scope.go:117] "RemoveContainer" containerID="342200c8ad3cb1d4f40ab7e626d12510c01ad8c8e48d4289ca62a0ea6da4769b"
Jul 22 21:30:05.587201 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:30:05.587176    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"342200c8ad3cb1d4f40ab7e626d12510c01ad8c8e48d4289ca62a0ea6da4769b\": container with ID starting with 342200c8ad3cb1d4f40ab7e626d12510c01ad8c8e48d4289ca62a0ea6da4769b not found: ID does not exist" containerID="342200c8ad3cb1d4f40ab7e626d12510c01ad8c8e48d4289ca62a0ea6da4769b"
Jul 22 21:30:05.587290 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.587215    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"342200c8ad3cb1d4f40ab7e626d12510c01ad8c8e48d4289ca62a0ea6da4769b"} err="failed to get container status \"342200c8ad3cb1d4f40ab7e626d12510c01ad8c8e48d4289ca62a0ea6da4769b\": rpc error: code = NotFound desc = could not find container \"342200c8ad3cb1d4f40ab7e626d12510c01ad8c8e48d4289ca62a0ea6da4769b\": container with ID starting with 342200c8ad3cb1d4f40ab7e626d12510c01ad8c8e48d4289ca62a0ea6da4769b not found: ID does not exist"
Jul 22 21:30:05.587290 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.587239    2583 scope.go:117] "RemoveContainer" containerID="900d42c12633996a07e93034d71a87a23052e882879d705e072d0ad4c5239c8e"
Jul 22 21:30:05.587525 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:30:05.587507    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"900d42c12633996a07e93034d71a87a23052e882879d705e072d0ad4c5239c8e\": container with ID starting with 900d42c12633996a07e93034d71a87a23052e882879d705e072d0ad4c5239c8e not found: ID does not exist" containerID="900d42c12633996a07e93034d71a87a23052e882879d705e072d0ad4c5239c8e"
Jul 22 21:30:05.587583 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.587534    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"900d42c12633996a07e93034d71a87a23052e882879d705e072d0ad4c5239c8e"} err="failed to get container status \"900d42c12633996a07e93034d71a87a23052e882879d705e072d0ad4c5239c8e\": rpc error: code = NotFound desc = could not find container \"900d42c12633996a07e93034d71a87a23052e882879d705e072d0ad4c5239c8e\": container with ID starting with 900d42c12633996a07e93034d71a87a23052e882879d705e072d0ad4c5239c8e not found: ID does not exist"
Jul 22 21:30:05.593068 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.593035    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"]
Jul 22 21:30:05.599568 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:05.599541    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1f4291a2-openshift-default-557c84c8ff-8t5vw"]
Jul 22 21:30:06.409781 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:06.409730    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67ecb85a-02a1-4942-83d1-0e0e3cf83785" path="/var/lib/kubelet/pods/67ecb85a-02a1-4942-83d1-0e0e3cf83785/volumes"
Jul 22 21:30:15.612438 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:15.612406    2583 generic.go:356] "Generic (PLEG): container finished" podID="2baafa89-9812-4bfa-83cc-79a7e2753a9b" containerID="e12d0731523a61a6ce65d085721b01fd56cb3f43a21aa72ffce0a8a03895003a" exitCode=0
Jul 22 21:30:15.612855 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:15.612465    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn" event={"ID":"2baafa89-9812-4bfa-83cc-79a7e2753a9b","Type":"ContainerDied","Data":"e12d0731523a61a6ce65d085721b01fd56cb3f43a21aa72ffce0a8a03895003a"}
Jul 22 21:30:15.612855 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:15.612794    2583 scope.go:117] "RemoveContainer" containerID="e12d0731523a61a6ce65d085721b01fd56cb3f43a21aa72ffce0a8a03895003a"
Jul 22 21:30:15.613914 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:15.613884    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:30:15.613977 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:15.613956    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:30:15.614012 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:15.613989    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:30:16.618574 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:16.618538    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn" event={"ID":"2baafa89-9812-4bfa-83cc-79a7e2753a9b","Type":"ContainerStarted","Data":"759546be0f725495311d45c5fa64478c7215e10e339b71e7cde1dc3c6844d921"}
Jul 22 21:30:16.860992 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:16.860939    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:16.861763 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:16.861726    2583 patch_prober.go:28] interesting pod/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 22 21:30:16.861872 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:16.861814    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn" podUID="2baafa89-9812-4bfa-83cc-79a7e2753a9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 22 21:30:17.859891 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:17.859848    2583 patch_prober.go:28] interesting pod/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 22 21:30:17.860401 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:17.859914    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn" podUID="2baafa89-9812-4bfa-83cc-79a7e2753a9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 22 21:30:18.551745 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:18.551712    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:18.860441 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:18.860405    2583 patch_prober.go:28] interesting pod/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 22 21:30:18.860904 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:18.860470    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn" podUID="2baafa89-9812-4bfa-83cc-79a7e2753a9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 22 21:30:19.860335 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:19.860297    2583 patch_prober.go:28] interesting pod/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 22 21:30:19.860639 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:19.860609    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn" podUID="2baafa89-9812-4bfa-83cc-79a7e2753a9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 22 21:30:20.864454 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:20.864424    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:20.865272 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:20.865254    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:43.025923 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:43.025884    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"]
Jul 22 21:30:43.026425 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:43.026144    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn" podUID="2baafa89-9812-4bfa-83cc-79a7e2753a9b" containerName="istio-proxy" containerID="cri-o://759546be0f725495311d45c5fa64478c7215e10e339b71e7cde1dc3c6844d921" gracePeriod=30
Jul 22 21:30:48.266146 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.266122    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:48.376357 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.376333    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cgxr\" (UniqueName: \"kubernetes.io/projected/2baafa89-9812-4bfa-83cc-79a7e2753a9b-kube-api-access-2cgxr\") pod \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") "
Jul 22 21:30:48.376468 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.376380    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istiod-ca-cert\") pod \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") "
Jul 22 21:30:48.376468 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.376407    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istio-data\") pod \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") "
Jul 22 21:30:48.376468 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.376434    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-workload-socket\") pod \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") "
Jul 22 21:30:48.376612 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.376474    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istio-podinfo\") pod \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") "
Jul 22 21:30:48.376612 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.376514    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-credential-socket\") pod \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") "
Jul 22 21:30:48.376612 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.376565    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istio-envoy\") pod \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") "
Jul 22 21:30:48.376766 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.376636    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istio-token\") pod \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") "
Jul 22 21:30:48.376766 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.376661    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-workload-certs\") pod \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\" (UID: \"2baafa89-9812-4bfa-83cc-79a7e2753a9b\") "
Jul 22 21:30:48.376766 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.376735    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2baafa89-9812-4bfa-83cc-79a7e2753a9b" (UID: "2baafa89-9812-4bfa-83cc-79a7e2753a9b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:30:48.376928 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.376774    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2baafa89-9812-4bfa-83cc-79a7e2753a9b" (UID: "2baafa89-9812-4bfa-83cc-79a7e2753a9b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:30:48.376982 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.376966    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2baafa89-9812-4bfa-83cc-79a7e2753a9b" (UID: "2baafa89-9812-4bfa-83cc-79a7e2753a9b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:30:48.377036 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.376982    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2baafa89-9812-4bfa-83cc-79a7e2753a9b" (UID: "2baafa89-9812-4bfa-83cc-79a7e2753a9b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:30:48.377311 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.377200    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-workload-socket\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:30:48.377311 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.377273    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-credential-socket\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:30:48.377311 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.377287    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-workload-certs\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:30:48.377311 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.377300    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istiod-ca-cert\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:30:48.377743 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.377525    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istio-data" (OuterVolumeSpecName: "istio-data") pod "2baafa89-9812-4bfa-83cc-79a7e2753a9b" (UID: "2baafa89-9812-4bfa-83cc-79a7e2753a9b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:30:48.378743 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.378713    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2baafa89-9812-4bfa-83cc-79a7e2753a9b" (UID: "2baafa89-9812-4bfa-83cc-79a7e2753a9b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 21:30:48.378844 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.378789    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2baafa89-9812-4bfa-83cc-79a7e2753a9b-kube-api-access-2cgxr" (OuterVolumeSpecName: "kube-api-access-2cgxr") pod "2baafa89-9812-4bfa-83cc-79a7e2753a9b" (UID: "2baafa89-9812-4bfa-83cc-79a7e2753a9b"). InnerVolumeSpecName "kube-api-access-2cgxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:30:48.379043 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.379016    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istio-token" (OuterVolumeSpecName: "istio-token") pod "2baafa89-9812-4bfa-83cc-79a7e2753a9b" (UID: "2baafa89-9812-4bfa-83cc-79a7e2753a9b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:30:48.379043 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.379017    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2baafa89-9812-4bfa-83cc-79a7e2753a9b" (UID: "2baafa89-9812-4bfa-83cc-79a7e2753a9b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:30:48.477975 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.477951    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istio-podinfo\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:30:48.477975 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.477974    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istio-envoy\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:30:48.477975 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.477982    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istio-token\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:30:48.478176 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.477990    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cgxr\" (UniqueName: \"kubernetes.io/projected/2baafa89-9812-4bfa-83cc-79a7e2753a9b-kube-api-access-2cgxr\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:30:48.478176 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.477998    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2baafa89-9812-4bfa-83cc-79a7e2753a9b-istio-data\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:30:48.761987 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.761889    2583 generic.go:356] "Generic (PLEG): container finished" podID="2baafa89-9812-4bfa-83cc-79a7e2753a9b" containerID="759546be0f725495311d45c5fa64478c7215e10e339b71e7cde1dc3c6844d921" exitCode=0
Jul 22 21:30:48.761987 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.761928    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"
Jul 22 21:30:48.762226 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.761996    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn" event={"ID":"2baafa89-9812-4bfa-83cc-79a7e2753a9b","Type":"ContainerDied","Data":"759546be0f725495311d45c5fa64478c7215e10e339b71e7cde1dc3c6844d921"}
Jul 22 21:30:48.762226 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.762057    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn" event={"ID":"2baafa89-9812-4bfa-83cc-79a7e2753a9b","Type":"ContainerDied","Data":"33b1405a8316caf8fca509b01cd3bdfb5f0b455f31ffef98a1263004391a257b"}
Jul 22 21:30:48.762226 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.762087    2583 scope.go:117] "RemoveContainer" containerID="759546be0f725495311d45c5fa64478c7215e10e339b71e7cde1dc3c6844d921"
Jul 22 21:30:48.770776 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.770759    2583 scope.go:117] "RemoveContainer" containerID="e12d0731523a61a6ce65d085721b01fd56cb3f43a21aa72ffce0a8a03895003a"
Jul 22 21:30:48.779939 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.779813    2583 scope.go:117] "RemoveContainer" containerID="759546be0f725495311d45c5fa64478c7215e10e339b71e7cde1dc3c6844d921"
Jul 22 21:30:48.780078 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.780014    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"]
Jul 22 21:30:48.781047 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:30:48.781019    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"759546be0f725495311d45c5fa64478c7215e10e339b71e7cde1dc3c6844d921\": container with ID starting with 759546be0f725495311d45c5fa64478c7215e10e339b71e7cde1dc3c6844d921 not found: ID does not exist" containerID="759546be0f725495311d45c5fa64478c7215e10e339b71e7cde1dc3c6844d921"
Jul 22 21:30:48.781212 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.781059    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"759546be0f725495311d45c5fa64478c7215e10e339b71e7cde1dc3c6844d921"} err="failed to get container status \"759546be0f725495311d45c5fa64478c7215e10e339b71e7cde1dc3c6844d921\": rpc error: code = NotFound desc = could not find container \"759546be0f725495311d45c5fa64478c7215e10e339b71e7cde1dc3c6844d921\": container with ID starting with 759546be0f725495311d45c5fa64478c7215e10e339b71e7cde1dc3c6844d921 not found: ID does not exist"
Jul 22 21:30:48.781212 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.781085    2583 scope.go:117] "RemoveContainer" containerID="e12d0731523a61a6ce65d085721b01fd56cb3f43a21aa72ffce0a8a03895003a"
Jul 22 21:30:48.781419 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:30:48.781400    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e12d0731523a61a6ce65d085721b01fd56cb3f43a21aa72ffce0a8a03895003a\": container with ID starting with e12d0731523a61a6ce65d085721b01fd56cb3f43a21aa72ffce0a8a03895003a not found: ID does not exist" containerID="e12d0731523a61a6ce65d085721b01fd56cb3f43a21aa72ffce0a8a03895003a"
Jul 22 21:30:48.781475 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.781427    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e12d0731523a61a6ce65d085721b01fd56cb3f43a21aa72ffce0a8a03895003a"} err="failed to get container status \"e12d0731523a61a6ce65d085721b01fd56cb3f43a21aa72ffce0a8a03895003a\": rpc error: code = NotFound desc = could not find container \"e12d0731523a61a6ce65d085721b01fd56cb3f43a21aa72ffce0a8a03895003a\": container with ID starting with e12d0731523a61a6ce65d085721b01fd56cb3f43a21aa72ffce0a8a03895003a not found: ID does not exist"
Jul 22 21:30:48.782269 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:48.782246    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-a5095382-openshift-default-59f866b79f-h5rcn"]
Jul 22 21:30:50.410318 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:30:50.410282    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2baafa89-9812-4bfa-83cc-79a7e2753a9b" path="/var/lib/kubelet/pods/2baafa89-9812-4bfa-83cc-79a7e2753a9b/volumes"
Jul 22 21:32:20.461623 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.461591    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"]
Jul 22 21:32:20.462184 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.461903    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67ecb85a-02a1-4942-83d1-0e0e3cf83785" containerName="istio-proxy"
Jul 22 21:32:20.462184 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.461915    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="67ecb85a-02a1-4942-83d1-0e0e3cf83785" containerName="istio-proxy"
Jul 22 21:32:20.462184 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.461937    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2baafa89-9812-4bfa-83cc-79a7e2753a9b" containerName="istio-proxy"
Jul 22 21:32:20.462184 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.461942    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2baafa89-9812-4bfa-83cc-79a7e2753a9b" containerName="istio-proxy"
Jul 22 21:32:20.462184 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.461950    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2baafa89-9812-4bfa-83cc-79a7e2753a9b" containerName="istio-proxy"
Jul 22 21:32:20.462184 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.461956    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2baafa89-9812-4bfa-83cc-79a7e2753a9b" containerName="istio-proxy"
Jul 22 21:32:20.462184 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.462001    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="67ecb85a-02a1-4942-83d1-0e0e3cf83785" containerName="istio-proxy"
Jul 22 21:32:20.462184 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.462009    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="67ecb85a-02a1-4942-83d1-0e0e3cf83785" containerName="istio-proxy"
Jul 22 21:32:20.462184 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.462015    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2baafa89-9812-4bfa-83cc-79a7e2753a9b" containerName="istio-proxy"
Jul 22 21:32:20.462184 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.462022    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1af6a4e-595e-477d-9dcd-c976c1b552c8" containerName="istio-proxy"
Jul 22 21:32:20.464892 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.464874    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.467193 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.467169    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 22 21:32:20.467289 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.467234    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-84ba5c64-openshift-default-dockercfg-nm45w\""
Jul 22 21:32:20.486843 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.486812    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"]
Jul 22 21:32:20.611934 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.611900    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-credential-socket\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.612102 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.611961    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccd5b427-e58c-4be1-839d-bf534525f010-istio-token\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.612102 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.612011    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-workload-socket\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.612102 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.612050    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-istio-envoy\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.612311 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.612137    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-workload-certs\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.612311 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.612168    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-istio-data\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.612311 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.612195    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccd5b427-e58c-4be1-839d-bf534525f010-istio-podinfo\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.612311 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.612224    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp96h\" (UniqueName: \"kubernetes.io/projected/ccd5b427-e58c-4be1-839d-bf534525f010-kube-api-access-sp96h\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.612311 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.612305    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccd5b427-e58c-4be1-839d-bf534525f010-istiod-ca-cert\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.713728 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.713639    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccd5b427-e58c-4be1-839d-bf534525f010-istio-token\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.713728 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.713679    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-workload-socket\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.713728 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.713714    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-istio-envoy\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.713983 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.713759    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-workload-certs\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.713983 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.713781    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-istio-data\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.713983 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.713805    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccd5b427-e58c-4be1-839d-bf534525f010-istio-podinfo\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.713983 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.713829    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp96h\" (UniqueName: \"kubernetes.io/projected/ccd5b427-e58c-4be1-839d-bf534525f010-kube-api-access-sp96h\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.713983 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.713874    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccd5b427-e58c-4be1-839d-bf534525f010-istiod-ca-cert\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.713983 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.713921    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-credential-socket\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.714319 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.714283    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-workload-socket\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.714364 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.714317    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-workload-certs\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.714475 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.714448    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-credential-socket\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.714526 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.714488    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-istio-data\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.714669 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.714653    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccd5b427-e58c-4be1-839d-bf534525f010-istiod-ca-cert\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.716262 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.716241    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-istio-envoy\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.716377 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.716361    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccd5b427-e58c-4be1-839d-bf534525f010-istio-podinfo\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.736793 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.736762    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccd5b427-e58c-4be1-839d-bf534525f010-istio-token\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.737067 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.737048    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp96h\" (UniqueName: \"kubernetes.io/projected/ccd5b427-e58c-4be1-839d-bf534525f010-kube-api-access-sp96h\") pod \"e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") " pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.776084 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.776058    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:20.910198 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.910041    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"]
Jul 22 21:32:20.912381 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:32:20.912354    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccd5b427_e58c_4be1_839d_bf534525f010.slice/crio-917eb9a4cfb60e84f940c8a996e5f7ef554d0f8b1943fead307014277b47c1f3 WatchSource:0}: Error finding container 917eb9a4cfb60e84f940c8a996e5f7ef554d0f8b1943fead307014277b47c1f3: Status 404 returned error can't find the container with id 917eb9a4cfb60e84f940c8a996e5f7ef554d0f8b1943fead307014277b47c1f3
Jul 22 21:32:20.914502 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.914472    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:32:20.914575 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.914533    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:32:20.914575 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:20.914560    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:32:21.147589 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:21.147551    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg" event={"ID":"ccd5b427-e58c-4be1-839d-bf534525f010","Type":"ContainerStarted","Data":"8ce672657e173f555fa03ac0d5e670e110e8667e9220c7fc23f22d1be71ff882"}
Jul 22 21:32:21.147759 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:21.147620    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg" event={"ID":"ccd5b427-e58c-4be1-839d-bf534525f010","Type":"ContainerStarted","Data":"917eb9a4cfb60e84f940c8a996e5f7ef554d0f8b1943fead307014277b47c1f3"}
Jul 22 21:32:21.169191 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:21.169130    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg" podStartSLOduration=1.16909208 podStartE2EDuration="1.16909208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:32:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:32:21.167563281 +0000 UTC m=+2139.191601862" watchObservedRunningTime="2026-07-22 21:32:21.16909208 +0000 UTC m=+2139.193130737"
Jul 22 21:32:21.776976 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:21.776945    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:21.781469 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:21.781446    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:22.153102 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:22.153075    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:22.153908 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:22.153891    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:34.914435 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:34.914400    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ba5c64-vwph8"]
Jul 22 21:32:34.914921 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:34.914901    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67ecb85a-02a1-4942-83d1-0e0e3cf83785" containerName="istio-proxy"
Jul 22 21:32:34.914997 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:34.914925    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="67ecb85a-02a1-4942-83d1-0e0e3cf83785" containerName="istio-proxy"
Jul 22 21:32:34.915049 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:34.915004    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2baafa89-9812-4bfa-83cc-79a7e2753a9b" containerName="istio-proxy"
Jul 22 21:32:34.917897 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:34.917878    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ba5c64-vwph8"
Jul 22 21:32:34.920268 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:34.920244    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zz5vc\""
Jul 22 21:32:34.925849 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:34.925828    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ba5c64-vwph8"]
Jul 22 21:32:34.932201 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:34.932175    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84d8eda7-1851-4ae1-98d2-c13a1c31e5b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-84ba5c64-vwph8\" (UID: \"84d8eda7-1851-4ae1-98d2-c13a1c31e5b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ba5c64-vwph8"
Jul 22 21:32:35.033220 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:35.033161    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84d8eda7-1851-4ae1-98d2-c13a1c31e5b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-84ba5c64-vwph8\" (UID: \"84d8eda7-1851-4ae1-98d2-c13a1c31e5b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ba5c64-vwph8"
Jul 22 21:32:35.033911 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:35.033891    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84d8eda7-1851-4ae1-98d2-c13a1c31e5b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-84ba5c64-vwph8\" (UID: \"84d8eda7-1851-4ae1-98d2-c13a1c31e5b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ba5c64-vwph8"
Jul 22 21:32:35.229840 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:35.229804    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ba5c64-vwph8"
Jul 22 21:32:35.374342 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:35.374247    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ba5c64-vwph8"]
Jul 22 21:32:36.216404 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:36.216364    2583 generic.go:356] "Generic (PLEG): container finished" podID="84d8eda7-1851-4ae1-98d2-c13a1c31e5b4" containerID="956b9454ccab43a6cff0a3339fc69120fcf260ff9552c5e6c61d796badeb9d8d" exitCode=0
Jul 22 21:32:36.216775 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:36.216412    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ba5c64-vwph8" event={"ID":"84d8eda7-1851-4ae1-98d2-c13a1c31e5b4","Type":"ContainerDied","Data":"956b9454ccab43a6cff0a3339fc69120fcf260ff9552c5e6c61d796badeb9d8d"}
Jul 22 21:32:36.216775 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:36.216470    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ba5c64-vwph8" event={"ID":"84d8eda7-1851-4ae1-98d2-c13a1c31e5b4","Type":"ContainerStarted","Data":"2a1a4d7e4a967147dc713adc6ad906a596032d1574be5ba1a5033c618c9d3063"}
Jul 22 21:32:37.175192 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:37.174990    2583 patch_prober.go:28] interesting pod/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": read tcp 10.132.0.2:35276->10.132.0.36:15021: read: connection reset by peer" start-of-body=
Jul 22 21:32:37.175192 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:37.175046    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg" podUID="ccd5b427-e58c-4be1-839d-bf534525f010" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": read tcp 10.132.0.2:35276->10.132.0.36:15021: read: connection reset by peer"
Jul 22 21:32:37.221719 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:37.221693    2583 generic.go:356] "Generic (PLEG): container finished" podID="ccd5b427-e58c-4be1-839d-bf534525f010" containerID="8ce672657e173f555fa03ac0d5e670e110e8667e9220c7fc23f22d1be71ff882" exitCode=0
Jul 22 21:32:37.221993 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:37.221761    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg" event={"ID":"ccd5b427-e58c-4be1-839d-bf534525f010","Type":"ContainerDied","Data":"8ce672657e173f555fa03ac0d5e670e110e8667e9220c7fc23f22d1be71ff882"}
Jul 22 21:32:37.222512 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:37.222234    2583 scope.go:117] "RemoveContainer" containerID="8ce672657e173f555fa03ac0d5e670e110e8667e9220c7fc23f22d1be71ff882"
Jul 22 21:32:37.223403 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:37.223376    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:32:37.223511 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:37.223459    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:32:37.223581 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:37.223508    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:32:37.359864 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:37.359814    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ba5c64-vwph8"
Jul 22 21:32:37.455236 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:37.455174    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84d8eda7-1851-4ae1-98d2-c13a1c31e5b4-maas-api-service-ca\") pod \"84d8eda7-1851-4ae1-98d2-c13a1c31e5b4\" (UID: \"84d8eda7-1851-4ae1-98d2-c13a1c31e5b4\") "
Jul 22 21:32:37.455555 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:37.455535    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84d8eda7-1851-4ae1-98d2-c13a1c31e5b4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "84d8eda7-1851-4ae1-98d2-c13a1c31e5b4" (UID: "84d8eda7-1851-4ae1-98d2-c13a1c31e5b4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:32:37.556667 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:37.556639    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84d8eda7-1851-4ae1-98d2-c13a1c31e5b4-maas-api-service-ca\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:32:38.227663 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:38.227627    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg" event={"ID":"ccd5b427-e58c-4be1-839d-bf534525f010","Type":"ContainerStarted","Data":"d48ea965704653162674510194580e8e0ffcc35b1f984c221c39a75d5890bfeb"}
Jul 22 21:32:38.228941 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:38.228918    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ba5c64-vwph8"
Jul 22 21:32:38.229060 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:38.228945    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ba5c64-vwph8" event={"ID":"84d8eda7-1851-4ae1-98d2-c13a1c31e5b4","Type":"ContainerDied","Data":"2a1a4d7e4a967147dc713adc6ad906a596032d1574be5ba1a5033c618c9d3063"}
Jul 22 21:32:38.229060 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:38.228982    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a1a4d7e4a967147dc713adc6ad906a596032d1574be5ba1a5033c618c9d3063"
Jul 22 21:32:38.777083 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:38.777034    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:38.777423 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:38.777215    2583 patch_prober.go:28] interesting pod/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 22 21:32:38.777585 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:38.777560    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg" podUID="ccd5b427-e58c-4be1-839d-bf534525f010" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 22 21:32:39.776394 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:39.776359    2583 patch_prober.go:28] interesting pod/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 22 21:32:39.776982 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:39.776938    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg" podUID="ccd5b427-e58c-4be1-839d-bf534525f010" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 22 21:32:40.777281 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:40.777241    2583 patch_prober.go:28] interesting pod/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 22 21:32:40.777887 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:40.777856    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg" podUID="ccd5b427-e58c-4be1-839d-bf534525f010" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 22 21:32:41.776604 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:41.776567    2583 patch_prober.go:28] interesting pod/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 22 21:32:41.776805 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:41.776646    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg" podUID="ccd5b427-e58c-4be1-839d-bf534525f010" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 22 21:32:42.780352 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:42.780316    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:42.780822 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:42.780719    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:42.781447 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:42.781430    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:32:49.982026 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:49.981988    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ba5c64-vwph8"]
Jul 22 21:32:49.984941 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:49.984915    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-84ba5c64-vwph8"]
Jul 22 21:32:50.409537 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:50.409504    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84d8eda7-1851-4ae1-98d2-c13a1c31e5b4" path="/var/lib/kubelet/pods/84d8eda7-1851-4ae1-98d2-c13a1c31e5b4/volumes"
Jul 22 21:32:56.531198 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:56.531153    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"]
Jul 22 21:32:56.531775 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:56.531426    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg" podUID="ccd5b427-e58c-4be1-839d-bf534525f010" containerName="istio-proxy" containerID="cri-o://d48ea965704653162674510194580e8e0ffcc35b1f984c221c39a75d5890bfeb" gracePeriod=30
Jul 22 21:32:57.783274 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:57.783236    2583 patch_prober.go:28] interesting pod/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 21:32:57.783708 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:32:57.783310    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg" podUID="ccd5b427-e58c-4be1-839d-bf534525f010" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 21:33:01.783331 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.783300    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:33:01.877515 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.877474    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-credential-socket\") pod \"ccd5b427-e58c-4be1-839d-bf534525f010\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") "
Jul 22 21:33:01.877515 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.877520    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-istio-envoy\") pod \"ccd5b427-e58c-4be1-839d-bf534525f010\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") "
Jul 22 21:33:01.877783 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.877538    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccd5b427-e58c-4be1-839d-bf534525f010-istiod-ca-cert\") pod \"ccd5b427-e58c-4be1-839d-bf534525f010\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") "
Jul 22 21:33:01.877783 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.877568    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-workload-certs\") pod \"ccd5b427-e58c-4be1-839d-bf534525f010\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") "
Jul 22 21:33:01.877783 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.877597    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-workload-socket\") pod \"ccd5b427-e58c-4be1-839d-bf534525f010\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") "
Jul 22 21:33:01.877783 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.877614    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sp96h\" (UniqueName: \"kubernetes.io/projected/ccd5b427-e58c-4be1-839d-bf534525f010-kube-api-access-sp96h\") pod \"ccd5b427-e58c-4be1-839d-bf534525f010\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") "
Jul 22 21:33:01.877783 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.877640    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-istio-data\") pod \"ccd5b427-e58c-4be1-839d-bf534525f010\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") "
Jul 22 21:33:01.877783 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.877694    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccd5b427-e58c-4be1-839d-bf534525f010-istio-podinfo\") pod \"ccd5b427-e58c-4be1-839d-bf534525f010\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") "
Jul 22 21:33:01.877783 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.877757    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccd5b427-e58c-4be1-839d-bf534525f010-istio-token\") pod \"ccd5b427-e58c-4be1-839d-bf534525f010\" (UID: \"ccd5b427-e58c-4be1-839d-bf534525f010\") "
Jul 22 21:33:01.878157 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.877861    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ccd5b427-e58c-4be1-839d-bf534525f010" (UID: "ccd5b427-e58c-4be1-839d-bf534525f010"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:33:01.878157 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.878032    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ccd5b427-e58c-4be1-839d-bf534525f010" (UID: "ccd5b427-e58c-4be1-839d-bf534525f010"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:33:01.878157 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.878072    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-credential-socket\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:33:01.878157 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.878082    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccd5b427-e58c-4be1-839d-bf534525f010-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ccd5b427-e58c-4be1-839d-bf534525f010" (UID: "ccd5b427-e58c-4be1-839d-bf534525f010"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:33:01.878368 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.878345    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ccd5b427-e58c-4be1-839d-bf534525f010" (UID: "ccd5b427-e58c-4be1-839d-bf534525f010"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:33:01.879029 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.878997    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-istio-data" (OuterVolumeSpecName: "istio-data") pod "ccd5b427-e58c-4be1-839d-bf534525f010" (UID: "ccd5b427-e58c-4be1-839d-bf534525f010"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:33:01.880163 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.880126    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ccd5b427-e58c-4be1-839d-bf534525f010-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ccd5b427-e58c-4be1-839d-bf534525f010" (UID: "ccd5b427-e58c-4be1-839d-bf534525f010"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 21:33:01.880261 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.880212    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccd5b427-e58c-4be1-839d-bf534525f010-kube-api-access-sp96h" (OuterVolumeSpecName: "kube-api-access-sp96h") pod "ccd5b427-e58c-4be1-839d-bf534525f010" (UID: "ccd5b427-e58c-4be1-839d-bf534525f010"). InnerVolumeSpecName "kube-api-access-sp96h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:33:01.880525 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.880506    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccd5b427-e58c-4be1-839d-bf534525f010-istio-token" (OuterVolumeSpecName: "istio-token") pod "ccd5b427-e58c-4be1-839d-bf534525f010" (UID: "ccd5b427-e58c-4be1-839d-bf534525f010"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:33:01.880572 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.880515    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ccd5b427-e58c-4be1-839d-bf534525f010" (UID: "ccd5b427-e58c-4be1-839d-bf534525f010"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:33:01.978966 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.978904    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-istio-envoy\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:33:01.978966 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.978952    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccd5b427-e58c-4be1-839d-bf534525f010-istiod-ca-cert\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:33:01.978966 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.978963    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-workload-certs\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:33:01.978966 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.978971    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-workload-socket\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:33:01.978966 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.978980    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sp96h\" (UniqueName: \"kubernetes.io/projected/ccd5b427-e58c-4be1-839d-bf534525f010-kube-api-access-sp96h\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:33:01.978966 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.978989    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccd5b427-e58c-4be1-839d-bf534525f010-istio-data\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:33:01.979363 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.978998    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccd5b427-e58c-4be1-839d-bf534525f010-istio-podinfo\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:33:01.979363 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:01.979006    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccd5b427-e58c-4be1-839d-bf534525f010-istio-token\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:33:02.340199 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:02.340083    2583 generic.go:356] "Generic (PLEG): container finished" podID="ccd5b427-e58c-4be1-839d-bf534525f010" containerID="d48ea965704653162674510194580e8e0ffcc35b1f984c221c39a75d5890bfeb" exitCode=0
Jul 22 21:33:02.340199 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:02.340145    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg" event={"ID":"ccd5b427-e58c-4be1-839d-bf534525f010","Type":"ContainerDied","Data":"d48ea965704653162674510194580e8e0ffcc35b1f984c221c39a75d5890bfeb"}
Jul 22 21:33:02.340199 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:02.340156    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"
Jul 22 21:33:02.340199 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:02.340192    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg" event={"ID":"ccd5b427-e58c-4be1-839d-bf534525f010","Type":"ContainerDied","Data":"917eb9a4cfb60e84f940c8a996e5f7ef554d0f8b1943fead307014277b47c1f3"}
Jul 22 21:33:02.340544 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:02.340215    2583 scope.go:117] "RemoveContainer" containerID="d48ea965704653162674510194580e8e0ffcc35b1f984c221c39a75d5890bfeb"
Jul 22 21:33:02.352221 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:02.352192    2583 scope.go:117] "RemoveContainer" containerID="8ce672657e173f555fa03ac0d5e670e110e8667e9220c7fc23f22d1be71ff882"
Jul 22 21:33:02.361912 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:02.361886    2583 scope.go:117] "RemoveContainer" containerID="d48ea965704653162674510194580e8e0ffcc35b1f984c221c39a75d5890bfeb"
Jul 22 21:33:02.362297 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:33:02.362275    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d48ea965704653162674510194580e8e0ffcc35b1f984c221c39a75d5890bfeb\": container with ID starting with d48ea965704653162674510194580e8e0ffcc35b1f984c221c39a75d5890bfeb not found: ID does not exist" containerID="d48ea965704653162674510194580e8e0ffcc35b1f984c221c39a75d5890bfeb"
Jul 22 21:33:02.362380 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:02.362307    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d48ea965704653162674510194580e8e0ffcc35b1f984c221c39a75d5890bfeb"} err="failed to get container status \"d48ea965704653162674510194580e8e0ffcc35b1f984c221c39a75d5890bfeb\": rpc error: code = NotFound desc = could not find container \"d48ea965704653162674510194580e8e0ffcc35b1f984c221c39a75d5890bfeb\": container with ID starting with d48ea965704653162674510194580e8e0ffcc35b1f984c221c39a75d5890bfeb not found: ID does not exist"
Jul 22 21:33:02.362380 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:02.362327    2583 scope.go:117] "RemoveContainer" containerID="8ce672657e173f555fa03ac0d5e670e110e8667e9220c7fc23f22d1be71ff882"
Jul 22 21:33:02.362605 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:33:02.362586    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ce672657e173f555fa03ac0d5e670e110e8667e9220c7fc23f22d1be71ff882\": container with ID starting with 8ce672657e173f555fa03ac0d5e670e110e8667e9220c7fc23f22d1be71ff882 not found: ID does not exist" containerID="8ce672657e173f555fa03ac0d5e670e110e8667e9220c7fc23f22d1be71ff882"
Jul 22 21:33:02.362685 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:02.362609    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ce672657e173f555fa03ac0d5e670e110e8667e9220c7fc23f22d1be71ff882"} err="failed to get container status \"8ce672657e173f555fa03ac0d5e670e110e8667e9220c7fc23f22d1be71ff882\": rpc error: code = NotFound desc = could not find container \"8ce672657e173f555fa03ac0d5e670e110e8667e9220c7fc23f22d1be71ff882\": container with ID starting with 8ce672657e173f555fa03ac0d5e670e110e8667e9220c7fc23f22d1be71ff882 not found: ID does not exist"
Jul 22 21:33:02.363056 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:02.363034    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"]
Jul 22 21:33:02.368984 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:02.368950    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-84ba5c64-openshift-default-5c868d7c7f-2njtg"]
Jul 22 21:33:02.411063 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:02.411028    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccd5b427-e58c-4be1-839d-bf534525f010" path="/var/lib/kubelet/pods/ccd5b427-e58c-4be1-839d-bf534525f010/volumes"
Jul 22 21:33:15.979126 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:15.979084    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"]
Jul 22 21:33:15.979495 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:15.979442    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84d8eda7-1851-4ae1-98d2-c13a1c31e5b4" containerName="revoke-keys"
Jul 22 21:33:15.979495 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:15.979454    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="84d8eda7-1851-4ae1-98d2-c13a1c31e5b4" containerName="revoke-keys"
Jul 22 21:33:15.979495 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:15.979466    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccd5b427-e58c-4be1-839d-bf534525f010" containerName="istio-proxy"
Jul 22 21:33:15.979495 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:15.979472    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccd5b427-e58c-4be1-839d-bf534525f010" containerName="istio-proxy"
Jul 22 21:33:15.979495 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:15.979478    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccd5b427-e58c-4be1-839d-bf534525f010" containerName="istio-proxy"
Jul 22 21:33:15.979495 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:15.979484    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccd5b427-e58c-4be1-839d-bf534525f010" containerName="istio-proxy"
Jul 22 21:33:15.979684 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:15.979538    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccd5b427-e58c-4be1-839d-bf534525f010" containerName="istio-proxy"
Jul 22 21:33:15.979684 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:15.979546    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccd5b427-e58c-4be1-839d-bf534525f010" containerName="istio-proxy"
Jul 22 21:33:15.979684 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:15.979552    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="84d8eda7-1851-4ae1-98d2-c13a1c31e5b4" containerName="revoke-keys"
Jul 22 21:33:15.984154 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:15.984134    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:15.986816 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:15.986799    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e1e05235-openshift-default-dockercfg-6pjbv\""
Jul 22 21:33:15.987061 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:15.987043    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 22 21:33:15.997655 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:15.997632    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"]
Jul 22 21:33:16.095157 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.095128    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-credential-socket\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.095264 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.095169    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01774430-a24d-4910-a1cb-24694c7498a3-istiod-ca-cert\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.095264 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.095195    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-workload-socket\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.095264 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.095237    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-istio-data\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.095381 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.095265    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-workload-certs\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.095381 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.095284    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-istio-envoy\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.095381 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.095298    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01774430-a24d-4910-a1cb-24694c7498a3-istio-podinfo\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.095381 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.095325    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01774430-a24d-4910-a1cb-24694c7498a3-istio-token\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.095381 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.095342    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbrdk\" (UniqueName: \"kubernetes.io/projected/01774430-a24d-4910-a1cb-24694c7498a3-kube-api-access-nbrdk\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.196771 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.196733    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01774430-a24d-4910-a1cb-24694c7498a3-istio-token\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.196771 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.196772    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbrdk\" (UniqueName: \"kubernetes.io/projected/01774430-a24d-4910-a1cb-24694c7498a3-kube-api-access-nbrdk\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.196964 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.196824    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-credential-socket\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.196964 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.196850    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01774430-a24d-4910-a1cb-24694c7498a3-istiod-ca-cert\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.196964 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.196877    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-workload-socket\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.196964 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.196942    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-istio-data\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.197177 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.196972    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-workload-certs\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.197177 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.197000    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-istio-envoy\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.197177 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.197022    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01774430-a24d-4910-a1cb-24694c7498a3-istio-podinfo\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.197907 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.197888    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-credential-socket\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.199714 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.199678    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-workload-socket\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.199817 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.199718    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-workload-certs\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.199863 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.199841    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-istio-data\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.199947 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.199928    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01774430-a24d-4910-a1cb-24694c7498a3-istiod-ca-cert\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.201175 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.201155    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01774430-a24d-4910-a1cb-24694c7498a3-istio-podinfo\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.201704 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.201681    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-istio-envoy\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.205561 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.205542    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01774430-a24d-4910-a1cb-24694c7498a3-istio-token\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.205933 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.205910    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbrdk\" (UniqueName: \"kubernetes.io/projected/01774430-a24d-4910-a1cb-24694c7498a3-kube-api-access-nbrdk\") pod \"e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") " pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.294080 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.293988    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:16.431931 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.431812    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"]
Jul 22 21:33:16.434781 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:33:16.434749    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01774430_a24d_4910_a1cb_24694c7498a3.slice/crio-526547eb4981e224f44d4c685b0827a5d1a61f275e439357d19a737ea2337eff WatchSource:0}: Error finding container 526547eb4981e224f44d4c685b0827a5d1a61f275e439357d19a737ea2337eff: Status 404 returned error can't find the container with id 526547eb4981e224f44d4c685b0827a5d1a61f275e439357d19a737ea2337eff
Jul 22 21:33:16.436764 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.436735    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:33:16.436844 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.436799    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:33:16.436844 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:16.436826    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:33:17.408838 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:17.408801    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb" event={"ID":"01774430-a24d-4910-a1cb-24694c7498a3","Type":"ContainerStarted","Data":"5e2caa48136853e02850f62b9d1780c1489f9439893c17e6b6b25f38be0c8e81"}
Jul 22 21:33:17.409424 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:17.408880    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb" event={"ID":"01774430-a24d-4910-a1cb-24694c7498a3","Type":"ContainerStarted","Data":"526547eb4981e224f44d4c685b0827a5d1a61f275e439357d19a737ea2337eff"}
Jul 22 21:33:17.429754 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:17.429687    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb" podStartSLOduration=2.429668913 podStartE2EDuration="2.429668913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:33:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:33:17.428263633 +0000 UTC m=+2195.452302214" watchObservedRunningTime="2026-07-22 21:33:17.429668913 +0000 UTC m=+2195.453707492"
Jul 22 21:33:18.295086 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:18.295046    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:18.300104 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:18.300075    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:18.413173 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:18.413139    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:18.414187 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:18.414165    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:30.098913 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.098879    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"]
Jul 22 21:33:30.102677 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.102655    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:33:30.106172 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.106142    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e1e05235\"/\"kube-root-ca.crt\""
Jul 22 21:33:30.106301 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.106173    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e1e05235\"/\"e2e-lifecycle-model-e1e05235-kserve-self-signed-certs\""
Jul 22 21:33:30.106301 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.106183    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e1e05235\"/\"openshift-service-ca.crt\""
Jul 22 21:33:30.106301 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.106153    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e1e05235\"/\"default-dockercfg-b4gt5\""
Jul 22 21:33:30.111707 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.111682    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"]
Jul 22 21:33:30.210861 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.210829    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7a07e16-346a-4fe0-b553-749142e06236-tls-certs\") pod \"e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2\" (UID: \"b7a07e16-346a-4fe0-b553-749142e06236\") " pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:33:30.211015 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.210869    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7a07e16-346a-4fe0-b553-749142e06236-dshm\") pod \"e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2\" (UID: \"b7a07e16-346a-4fe0-b553-749142e06236\") " pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:33:30.211015 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.210940    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55p2l\" (UniqueName: \"kubernetes.io/projected/b7a07e16-346a-4fe0-b553-749142e06236-kube-api-access-55p2l\") pod \"e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2\" (UID: \"b7a07e16-346a-4fe0-b553-749142e06236\") " pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:33:30.211101 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.211021    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7a07e16-346a-4fe0-b553-749142e06236-home\") pod \"e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2\" (UID: \"b7a07e16-346a-4fe0-b553-749142e06236\") " pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:33:30.211101 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.211048    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7a07e16-346a-4fe0-b553-749142e06236-tmp-dir\") pod \"e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2\" (UID: \"b7a07e16-346a-4fe0-b553-749142e06236\") " pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:33:30.211101 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.211094    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7a07e16-346a-4fe0-b553-749142e06236-model-cache\") pod \"e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2\" (UID: \"b7a07e16-346a-4fe0-b553-749142e06236\") " pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:33:30.311944 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.311916    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7a07e16-346a-4fe0-b553-749142e06236-tmp-dir\") pod \"e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2\" (UID: \"b7a07e16-346a-4fe0-b553-749142e06236\") " pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:33:30.312076 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.311952    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7a07e16-346a-4fe0-b553-749142e06236-model-cache\") pod \"e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2\" (UID: \"b7a07e16-346a-4fe0-b553-749142e06236\") " pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:33:30.312076 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.311990    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7a07e16-346a-4fe0-b553-749142e06236-tls-certs\") pod \"e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2\" (UID: \"b7a07e16-346a-4fe0-b553-749142e06236\") " pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:33:30.312076 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.312022    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7a07e16-346a-4fe0-b553-749142e06236-dshm\") pod \"e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2\" (UID: \"b7a07e16-346a-4fe0-b553-749142e06236\") " pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:33:30.312076 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.312057    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55p2l\" (UniqueName: \"kubernetes.io/projected/b7a07e16-346a-4fe0-b553-749142e06236-kube-api-access-55p2l\") pod \"e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2\" (UID: \"b7a07e16-346a-4fe0-b553-749142e06236\") " pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:33:30.312301 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.312137    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7a07e16-346a-4fe0-b553-749142e06236-home\") pod \"e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2\" (UID: \"b7a07e16-346a-4fe0-b553-749142e06236\") " pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:33:30.312387 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.312366    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7a07e16-346a-4fe0-b553-749142e06236-tmp-dir\") pod \"e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2\" (UID: \"b7a07e16-346a-4fe0-b553-749142e06236\") " pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:33:30.312460 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.312397    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7a07e16-346a-4fe0-b553-749142e06236-model-cache\") pod \"e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2\" (UID: \"b7a07e16-346a-4fe0-b553-749142e06236\") " pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:33:30.312520 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.312466    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7a07e16-346a-4fe0-b553-749142e06236-home\") pod \"e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2\" (UID: \"b7a07e16-346a-4fe0-b553-749142e06236\") " pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:33:30.314413 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.314389    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7a07e16-346a-4fe0-b553-749142e06236-dshm\") pod \"e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2\" (UID: \"b7a07e16-346a-4fe0-b553-749142e06236\") " pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:33:30.314574 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.314556    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7a07e16-346a-4fe0-b553-749142e06236-tls-certs\") pod \"e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2\" (UID: \"b7a07e16-346a-4fe0-b553-749142e06236\") " pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:33:30.321954 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.321922    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55p2l\" (UniqueName: \"kubernetes.io/projected/b7a07e16-346a-4fe0-b553-749142e06236-kube-api-access-55p2l\") pod \"e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2\" (UID: \"b7a07e16-346a-4fe0-b553-749142e06236\") " pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:33:30.412535 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.412467    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:33:30.562052 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:30.562015    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"]
Jul 22 21:33:30.581311 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:33:30.581270    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7a07e16_346a_4fe0_b553_749142e06236.slice/crio-4f53edfa4fc1696a95c792aac43a1847fe8518d21de395a42951761247e71240 WatchSource:0}: Error finding container 4f53edfa4fc1696a95c792aac43a1847fe8518d21de395a42951761247e71240: Status 404 returned error can't find the container with id 4f53edfa4fc1696a95c792aac43a1847fe8518d21de395a42951761247e71240
Jul 22 21:33:31.486345 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:31.486314    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2" event={"ID":"b7a07e16-346a-4fe0-b553-749142e06236","Type":"ContainerStarted","Data":"d6026658cec89bd2bb5172e0bd4148e42e762ff37a49b3daa269acef89b48289"}
Jul 22 21:33:31.486700 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:31.486371    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2" event={"ID":"b7a07e16-346a-4fe0-b553-749142e06236","Type":"ContainerStarted","Data":"4f53edfa4fc1696a95c792aac43a1847fe8518d21de395a42951761247e71240"}
Jul 22 21:33:34.011532 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:34.010629    2583 patch_prober.go:28] interesting pod/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": read tcp 10.132.0.2:56622->10.132.0.38:15021: read: connection reset by peer" start-of-body=
Jul 22 21:33:34.011532 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:34.010705    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb" podUID="01774430-a24d-4910-a1cb-24694c7498a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": read tcp 10.132.0.2:56622->10.132.0.38:15021: read: connection reset by peer"
Jul 22 21:33:34.502777 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:34.502749    2583 generic.go:356] "Generic (PLEG): container finished" podID="01774430-a24d-4910-a1cb-24694c7498a3" containerID="5e2caa48136853e02850f62b9d1780c1489f9439893c17e6b6b25f38be0c8e81" exitCode=0
Jul 22 21:33:34.502929 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:34.502824    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb" event={"ID":"01774430-a24d-4910-a1cb-24694c7498a3","Type":"ContainerDied","Data":"5e2caa48136853e02850f62b9d1780c1489f9439893c17e6b6b25f38be0c8e81"}
Jul 22 21:33:34.503265 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:34.503250    2583 scope.go:117] "RemoveContainer" containerID="5e2caa48136853e02850f62b9d1780c1489f9439893c17e6b6b25f38be0c8e81"
Jul 22 21:33:34.507485 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:34.505556    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:33:34.507485 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:34.505803    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:33:34.507485 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:34.506036    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:33:34.522960 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:34.522918    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2" podStartSLOduration=4.522905603 podStartE2EDuration="4.522905603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:33:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:33:31.501293648 +0000 UTC m=+2209.525332228" watchObservedRunningTime="2026-07-22 21:33:34.522905603 +0000 UTC m=+2212.546944182"
Jul 22 21:33:35.509616 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:35.509582    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb" event={"ID":"01774430-a24d-4910-a1cb-24694c7498a3","Type":"ContainerStarted","Data":"7855ff57d77e87d3e12ca954eb94b4e6b79516c4796b0a3b9ccb437019150dd4"}
Jul 22 21:33:36.294879 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:36.294843    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:36.295082 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:36.294977    2583 patch_prober.go:28] interesting pod/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 22 21:33:36.295082 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:36.295032    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb" podUID="01774430-a24d-4910-a1cb-24694c7498a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 22 21:33:37.295321 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:37.295284    2583 patch_prober.go:28] interesting pod/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 22 21:33:37.295713 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:37.295336    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb" podUID="01774430-a24d-4910-a1cb-24694c7498a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 22 21:33:38.294403 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:38.294362    2583 patch_prober.go:28] interesting pod/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 22 21:33:38.294593 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:38.294416    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb" podUID="01774430-a24d-4910-a1cb-24694c7498a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 22 21:33:39.295001 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:39.294958    2583 patch_prober.go:28] interesting pod/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 22 21:33:39.295431 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:39.295015    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb" podUID="01774430-a24d-4910-a1cb-24694c7498a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 22 21:33:40.297946 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:40.297912    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:40.298333 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:40.298205    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:40.298822 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:40.298806    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:33:40.413017 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:40.412992    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:33:40.413017 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:40.413029    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:33:40.425339 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:40.425318    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:33:40.542093 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:33:40.542072    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:34:24.504148 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:24.504100    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"]
Jul 22 21:34:39.524688 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.524646    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2" podUID="b7a07e16-346a-4fe0-b553-749142e06236" containerName="main" containerID="cri-o://d6026658cec89bd2bb5172e0bd4148e42e762ff37a49b3daa269acef89b48289" gracePeriod=45
Jul 22 21:34:39.770368 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.770339    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:34:39.811875 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.811789    2583 generic.go:356] "Generic (PLEG): container finished" podID="b7a07e16-346a-4fe0-b553-749142e06236" containerID="d6026658cec89bd2bb5172e0bd4148e42e762ff37a49b3daa269acef89b48289" exitCode=0
Jul 22 21:34:39.811875 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.811831    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2" event={"ID":"b7a07e16-346a-4fe0-b553-749142e06236","Type":"ContainerDied","Data":"d6026658cec89bd2bb5172e0bd4148e42e762ff37a49b3daa269acef89b48289"}
Jul 22 21:34:39.812090 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.811879    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2" event={"ID":"b7a07e16-346a-4fe0-b553-749142e06236","Type":"ContainerDied","Data":"4f53edfa4fc1696a95c792aac43a1847fe8518d21de395a42951761247e71240"}
Jul 22 21:34:39.812090 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.811897    2583 scope.go:117] "RemoveContainer" containerID="d6026658cec89bd2bb5172e0bd4148e42e762ff37a49b3daa269acef89b48289"
Jul 22 21:34:39.812090 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.811960    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"
Jul 22 21:34:39.821731 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.821710    2583 scope.go:117] "RemoveContainer" containerID="d6026658cec89bd2bb5172e0bd4148e42e762ff37a49b3daa269acef89b48289"
Jul 22 21:34:39.822088 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:34:39.822057    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6026658cec89bd2bb5172e0bd4148e42e762ff37a49b3daa269acef89b48289\": container with ID starting with d6026658cec89bd2bb5172e0bd4148e42e762ff37a49b3daa269acef89b48289 not found: ID does not exist" containerID="d6026658cec89bd2bb5172e0bd4148e42e762ff37a49b3daa269acef89b48289"
Jul 22 21:34:39.822223 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.822100    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6026658cec89bd2bb5172e0bd4148e42e762ff37a49b3daa269acef89b48289"} err="failed to get container status \"d6026658cec89bd2bb5172e0bd4148e42e762ff37a49b3daa269acef89b48289\": rpc error: code = NotFound desc = could not find container \"d6026658cec89bd2bb5172e0bd4148e42e762ff37a49b3daa269acef89b48289\": container with ID starting with d6026658cec89bd2bb5172e0bd4148e42e762ff37a49b3daa269acef89b48289 not found: ID does not exist"
Jul 22 21:34:39.881805 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.881779    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7a07e16-346a-4fe0-b553-749142e06236-tls-certs\") pod \"b7a07e16-346a-4fe0-b553-749142e06236\" (UID: \"b7a07e16-346a-4fe0-b553-749142e06236\") "
Jul 22 21:34:39.881941 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.881870    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7a07e16-346a-4fe0-b553-749142e06236-tmp-dir\") pod \"b7a07e16-346a-4fe0-b553-749142e06236\" (UID: \"b7a07e16-346a-4fe0-b553-749142e06236\") "
Jul 22 21:34:39.881941 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.881898    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7a07e16-346a-4fe0-b553-749142e06236-model-cache\") pod \"b7a07e16-346a-4fe0-b553-749142e06236\" (UID: \"b7a07e16-346a-4fe0-b553-749142e06236\") "
Jul 22 21:34:39.882025 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.881939    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7a07e16-346a-4fe0-b553-749142e06236-home\") pod \"b7a07e16-346a-4fe0-b553-749142e06236\" (UID: \"b7a07e16-346a-4fe0-b553-749142e06236\") "
Jul 22 21:34:39.882084 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.882014    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55p2l\" (UniqueName: \"kubernetes.io/projected/b7a07e16-346a-4fe0-b553-749142e06236-kube-api-access-55p2l\") pod \"b7a07e16-346a-4fe0-b553-749142e06236\" (UID: \"b7a07e16-346a-4fe0-b553-749142e06236\") "
Jul 22 21:34:39.882084 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.882061    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7a07e16-346a-4fe0-b553-749142e06236-dshm\") pod \"b7a07e16-346a-4fe0-b553-749142e06236\" (UID: \"b7a07e16-346a-4fe0-b553-749142e06236\") "
Jul 22 21:34:39.882277 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.882188    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7a07e16-346a-4fe0-b553-749142e06236-model-cache" (OuterVolumeSpecName: "model-cache") pod "b7a07e16-346a-4fe0-b553-749142e06236" (UID: "b7a07e16-346a-4fe0-b553-749142e06236"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:34:39.882277 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.882204    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7a07e16-346a-4fe0-b553-749142e06236-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b7a07e16-346a-4fe0-b553-749142e06236" (UID: "b7a07e16-346a-4fe0-b553-749142e06236"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:34:39.882277 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.882258    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7a07e16-346a-4fe0-b553-749142e06236-home" (OuterVolumeSpecName: "home") pod "b7a07e16-346a-4fe0-b553-749142e06236" (UID: "b7a07e16-346a-4fe0-b553-749142e06236"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:34:39.882429 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.882416    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7a07e16-346a-4fe0-b553-749142e06236-home\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:34:39.882489 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.882456    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7a07e16-346a-4fe0-b553-749142e06236-tmp-dir\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:34:39.882489 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.882472    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7a07e16-346a-4fe0-b553-749142e06236-model-cache\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:34:39.884233 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.884201    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7a07e16-346a-4fe0-b553-749142e06236-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b7a07e16-346a-4fe0-b553-749142e06236" (UID: "b7a07e16-346a-4fe0-b553-749142e06236"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:34:39.884330 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.884242    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7a07e16-346a-4fe0-b553-749142e06236-kube-api-access-55p2l" (OuterVolumeSpecName: "kube-api-access-55p2l") pod "b7a07e16-346a-4fe0-b553-749142e06236" (UID: "b7a07e16-346a-4fe0-b553-749142e06236"). InnerVolumeSpecName "kube-api-access-55p2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:34:39.884380 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.884362    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7a07e16-346a-4fe0-b553-749142e06236-dshm" (OuterVolumeSpecName: "dshm") pod "b7a07e16-346a-4fe0-b553-749142e06236" (UID: "b7a07e16-346a-4fe0-b553-749142e06236"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:34:39.983818 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.983792    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55p2l\" (UniqueName: \"kubernetes.io/projected/b7a07e16-346a-4fe0-b553-749142e06236-kube-api-access-55p2l\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:34:39.983818 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.983816    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7a07e16-346a-4fe0-b553-749142e06236-dshm\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:34:39.983953 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:39.983826    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7a07e16-346a-4fe0-b553-749142e06236-tls-certs\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:34:40.132893 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:40.132870    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"]
Jul 22 21:34:40.136539 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:40.136517    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-e1e05235/e2e-lifecycle-model-e1e05235-kserve-5fd8b9c79f-7rks2"]
Jul 22 21:34:40.409428 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:34:40.409369    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7a07e16-346a-4fe0-b553-749142e06236" path="/var/lib/kubelet/pods/b7a07e16-346a-4fe0-b553-749142e06236/volumes"
Jul 22 21:35:07.802094 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:07.802063    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"]
Jul 22 21:35:07.802695 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:07.802294    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb" podUID="01774430-a24d-4910-a1cb-24694c7498a3" containerName="istio-proxy" containerID="cri-o://7855ff57d77e87d3e12ca954eb94b4e6b79516c4796b0a3b9ccb437019150dd4" gracePeriod=30
Jul 22 21:35:10.300126 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:10.300077    2583 patch_prober.go:28] interesting pod/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 21:35:10.300461 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:10.300159    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb" podUID="01774430-a24d-4910-a1cb-24694c7498a3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 21:35:12.956716 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:12.956687    2583 generic.go:356] "Generic (PLEG): container finished" podID="01774430-a24d-4910-a1cb-24694c7498a3" containerID="7855ff57d77e87d3e12ca954eb94b4e6b79516c4796b0a3b9ccb437019150dd4" exitCode=0
Jul 22 21:35:12.957153 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:12.956744    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb" event={"ID":"01774430-a24d-4910-a1cb-24694c7498a3","Type":"ContainerDied","Data":"7855ff57d77e87d3e12ca954eb94b4e6b79516c4796b0a3b9ccb437019150dd4"}
Jul 22 21:35:12.957153 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:12.956793    2583 scope.go:117] "RemoveContainer" containerID="5e2caa48136853e02850f62b9d1780c1489f9439893c17e6b6b25f38be0c8e81"
Jul 22 21:35:13.046561 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.046533    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:35:13.245161 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.245136    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-workload-socket\") pod \"01774430-a24d-4910-a1cb-24694c7498a3\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") "
Jul 22 21:35:13.245313 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.245169    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-workload-certs\") pod \"01774430-a24d-4910-a1cb-24694c7498a3\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") "
Jul 22 21:35:13.245313 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.245194    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-credential-socket\") pod \"01774430-a24d-4910-a1cb-24694c7498a3\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") "
Jul 22 21:35:13.245313 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.245216    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-istio-envoy\") pod \"01774430-a24d-4910-a1cb-24694c7498a3\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") "
Jul 22 21:35:13.245313 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.245233    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01774430-a24d-4910-a1cb-24694c7498a3-istiod-ca-cert\") pod \"01774430-a24d-4910-a1cb-24694c7498a3\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") "
Jul 22 21:35:13.245313 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.245251    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-istio-data\") pod \"01774430-a24d-4910-a1cb-24694c7498a3\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") "
Jul 22 21:35:13.245313 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.245300    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01774430-a24d-4910-a1cb-24694c7498a3-istio-token\") pod \"01774430-a24d-4910-a1cb-24694c7498a3\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") "
Jul 22 21:35:13.245593 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.245345    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbrdk\" (UniqueName: \"kubernetes.io/projected/01774430-a24d-4910-a1cb-24694c7498a3-kube-api-access-nbrdk\") pod \"01774430-a24d-4910-a1cb-24694c7498a3\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") "
Jul 22 21:35:13.245593 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.245383    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01774430-a24d-4910-a1cb-24694c7498a3-istio-podinfo\") pod \"01774430-a24d-4910-a1cb-24694c7498a3\" (UID: \"01774430-a24d-4910-a1cb-24694c7498a3\") "
Jul 22 21:35:13.245593 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.245382    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "01774430-a24d-4910-a1cb-24694c7498a3" (UID: "01774430-a24d-4910-a1cb-24694c7498a3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:35:13.245593 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.245500    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "01774430-a24d-4910-a1cb-24694c7498a3" (UID: "01774430-a24d-4910-a1cb-24694c7498a3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:35:13.245805 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.245603    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-workload-socket\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:35:13.245805 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.245622    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-workload-certs\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:35:13.245805 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.245749    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01774430-a24d-4910-a1cb-24694c7498a3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "01774430-a24d-4910-a1cb-24694c7498a3" (UID: "01774430-a24d-4910-a1cb-24694c7498a3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:35:13.246010 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.245897    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "01774430-a24d-4910-a1cb-24694c7498a3" (UID: "01774430-a24d-4910-a1cb-24694c7498a3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:35:13.246549 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.246518    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-istio-data" (OuterVolumeSpecName: "istio-data") pod "01774430-a24d-4910-a1cb-24694c7498a3" (UID: "01774430-a24d-4910-a1cb-24694c7498a3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:35:13.247711 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.247687    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01774430-a24d-4910-a1cb-24694c7498a3-kube-api-access-nbrdk" (OuterVolumeSpecName: "kube-api-access-nbrdk") pod "01774430-a24d-4910-a1cb-24694c7498a3" (UID: "01774430-a24d-4910-a1cb-24694c7498a3"). InnerVolumeSpecName "kube-api-access-nbrdk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:35:13.247711 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.247701    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/01774430-a24d-4910-a1cb-24694c7498a3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "01774430-a24d-4910-a1cb-24694c7498a3" (UID: "01774430-a24d-4910-a1cb-24694c7498a3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 21:35:13.247937 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.247918    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01774430-a24d-4910-a1cb-24694c7498a3-istio-token" (OuterVolumeSpecName: "istio-token") pod "01774430-a24d-4910-a1cb-24694c7498a3" (UID: "01774430-a24d-4910-a1cb-24694c7498a3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:35:13.248006 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.247979    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "01774430-a24d-4910-a1cb-24694c7498a3" (UID: "01774430-a24d-4910-a1cb-24694c7498a3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:35:13.346131 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.346083    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01774430-a24d-4910-a1cb-24694c7498a3-istio-podinfo\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:35:13.346131 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.346131    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-credential-socket\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:35:13.346290 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.346146    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-istio-envoy\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:35:13.346290 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.346157    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01774430-a24d-4910-a1cb-24694c7498a3-istiod-ca-cert\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:35:13.346290 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.346169    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01774430-a24d-4910-a1cb-24694c7498a3-istio-data\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:35:13.346290 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.346178    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01774430-a24d-4910-a1cb-24694c7498a3-istio-token\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:35:13.346290 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.346190    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbrdk\" (UniqueName: \"kubernetes.io/projected/01774430-a24d-4910-a1cb-24694c7498a3-kube-api-access-nbrdk\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:35:13.963246 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.963215    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb" event={"ID":"01774430-a24d-4910-a1cb-24694c7498a3","Type":"ContainerDied","Data":"526547eb4981e224f44d4c685b0827a5d1a61f275e439357d19a737ea2337eff"}
Jul 22 21:35:13.963644 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.963248    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"
Jul 22 21:35:13.963644 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.963277    2583 scope.go:117] "RemoveContainer" containerID="7855ff57d77e87d3e12ca954eb94b4e6b79516c4796b0a3b9ccb437019150dd4"
Jul 22 21:35:13.982453 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.982431    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"]
Jul 22 21:35:13.986293 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:13.986264    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e1e05235-openshift-default-6b544b7fff-fvfqb"]
Jul 22 21:35:14.409625 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:35:14.409602    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01774430-a24d-4910-a1cb-24694c7498a3" path="/var/lib/kubelet/pods/01774430-a24d-4910-a1cb-24694c7498a3/volumes"
Jul 22 21:36:03.164212 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.164168    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"]
Jul 22 21:36:03.164637 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.164518    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7a07e16-346a-4fe0-b553-749142e06236" containerName="main"
Jul 22 21:36:03.164637 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.164529    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7a07e16-346a-4fe0-b553-749142e06236" containerName="main"
Jul 22 21:36:03.164637 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.164539    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01774430-a24d-4910-a1cb-24694c7498a3" containerName="istio-proxy"
Jul 22 21:36:03.164637 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.164544    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="01774430-a24d-4910-a1cb-24694c7498a3" containerName="istio-proxy"
Jul 22 21:36:03.164637 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.164555    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01774430-a24d-4910-a1cb-24694c7498a3" containerName="istio-proxy"
Jul 22 21:36:03.164637 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.164560    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="01774430-a24d-4910-a1cb-24694c7498a3" containerName="istio-proxy"
Jul 22 21:36:03.164637 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.164608    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7a07e16-346a-4fe0-b553-749142e06236" containerName="main"
Jul 22 21:36:03.164637 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.164617    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="01774430-a24d-4910-a1cb-24694c7498a3" containerName="istio-proxy"
Jul 22 21:36:03.164637 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.164623    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="01774430-a24d-4910-a1cb-24694c7498a3" containerName="istio-proxy"
Jul 22 21:36:03.167535 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.167520    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.169868 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.169832    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 22 21:36:03.169982 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.169946    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-2f9a91-openshift-default-dockercfg-ddzp4\""
Jul 22 21:36:03.179469 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.179447    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"]
Jul 22 21:36:03.239778 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.239737    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-workload-certs\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.239778 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.239779    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e792c52e-181d-4850-a4bd-9dd696cde4c7-istio-podinfo\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.240001 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.239804    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-istio-envoy\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.240001 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.239835    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-workload-socket\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.240001 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.239919    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-credential-socket\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.240001 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.239976    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e792c52e-181d-4850-a4bd-9dd696cde4c7-istio-token\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.240195 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.240015    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-istio-data\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.240195 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.240038    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e792c52e-181d-4850-a4bd-9dd696cde4c7-istiod-ca-cert\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.240195 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.240055    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6bwm\" (UniqueName: \"kubernetes.io/projected/e792c52e-181d-4850-a4bd-9dd696cde4c7-kube-api-access-x6bwm\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.341474 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.341442    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e792c52e-181d-4850-a4bd-9dd696cde4c7-istio-token\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.341652 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.341491    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-istio-data\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.341652 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.341514    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e792c52e-181d-4850-a4bd-9dd696cde4c7-istiod-ca-cert\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.341652 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.341530    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6bwm\" (UniqueName: \"kubernetes.io/projected/e792c52e-181d-4850-a4bd-9dd696cde4c7-kube-api-access-x6bwm\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.341652 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.341555    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-workload-certs\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.341652 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.341576    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e792c52e-181d-4850-a4bd-9dd696cde4c7-istio-podinfo\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.341652 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.341602    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-istio-envoy\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.342239 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.341833    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-workload-socket\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.342239 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.341907    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-credential-socket\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.342239 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.341939    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-istio-data\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.342239 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.341999    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-workload-certs\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.342239 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.342230    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-credential-socket\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.342462 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.342259    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-workload-socket\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.342462 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.342403    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e792c52e-181d-4850-a4bd-9dd696cde4c7-istiod-ca-cert\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.344273 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.344253    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-istio-envoy\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.344346 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.344312    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e792c52e-181d-4850-a4bd-9dd696cde4c7-istio-podinfo\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.350563 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.350542    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e792c52e-181d-4850-a4bd-9dd696cde4c7-istio-token\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.350772 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.350752    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6bwm\" (UniqueName: \"kubernetes.io/projected/e792c52e-181d-4850-a4bd-9dd696cde4c7-kube-api-access-x6bwm\") pod \"e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") " pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.478591 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.478504    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:03.611072 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.611046    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"]
Jul 22 21:36:03.613331 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:36:03.613299    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode792c52e_181d_4850_a4bd_9dd696cde4c7.slice/crio-f3eeb4e28761859846fd0fb220a7ad36a9186f2577b949fd59c9bec9a1108a33 WatchSource:0}: Error finding container f3eeb4e28761859846fd0fb220a7ad36a9186f2577b949fd59c9bec9a1108a33: Status 404 returned error can't find the container with id f3eeb4e28761859846fd0fb220a7ad36a9186f2577b949fd59c9bec9a1108a33
Jul 22 21:36:03.615555 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.615525    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:36:03.615652 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.615590    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:36:03.615652 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:03.615618    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:36:04.182713 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:04.182683    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m" event={"ID":"e792c52e-181d-4850-a4bd-9dd696cde4c7","Type":"ContainerStarted","Data":"d33ff7d47360d201e8db34b9dca3969284430e91bf5606ab43406391d90d5b17"}
Jul 22 21:36:04.183141 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:04.182738    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m" event={"ID":"e792c52e-181d-4850-a4bd-9dd696cde4c7","Type":"ContainerStarted","Data":"f3eeb4e28761859846fd0fb220a7ad36a9186f2577b949fd59c9bec9a1108a33"}
Jul 22 21:36:04.202491 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:04.202433    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m" podStartSLOduration=1.202412161 podStartE2EDuration="1.202412161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:36:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:36:04.20101999 +0000 UTC m=+2362.225058570" watchObservedRunningTime="2026-07-22 21:36:04.202412161 +0000 UTC m=+2362.226450742"
Jul 22 21:36:04.478999 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:04.478918    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:04.483629 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:04.483605    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:05.187351 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:05.187325    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:05.188330 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:05.188308    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:11.358385 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.358347    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"]
Jul 22 21:36:11.361847 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.361822    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.364638 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.364617    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-1dd516-openshift-default-dockercfg-rlxpc\""
Jul 22 21:36:11.375707 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.375684    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"]
Jul 22 21:36:11.512391 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.512363    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istio-token\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.512542 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.512429    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzq24\" (UniqueName: \"kubernetes.io/projected/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-kube-api-access-pzq24\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.512542 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.512465    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istio-envoy\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.512638 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.512557    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istio-podinfo\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.512638 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.512617    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istio-data\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.512705 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.512694    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istiod-ca-cert\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.512739 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.512731    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-workload-certs\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.512775 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.512765    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-workload-socket\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.512808 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.512786    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-credential-socket\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.614098 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.613977    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istio-data\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.614098 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.614027    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istiod-ca-cert\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.614098 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.614059    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-workload-certs\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.614098 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.614077    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-workload-socket\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.614098 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.614092    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-credential-socket\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.614501 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.614143    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istio-token\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.614501 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.614194    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzq24\" (UniqueName: \"kubernetes.io/projected/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-kube-api-access-pzq24\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.614501 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.614233    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istio-envoy\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.614501 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.614273    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istio-podinfo\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.614501 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.614439    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istio-data\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.614836 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.614621    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-workload-socket\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.614836 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.614682    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-workload-certs\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.614836 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.614828    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-credential-socket\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.614998 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.614959    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istiod-ca-cert\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.616686 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.616667    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istio-envoy\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.616810 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.616793    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istio-podinfo\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.621773 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.621750    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istio-token\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.621857 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.621840    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzq24\" (UniqueName: \"kubernetes.io/projected/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-kube-api-access-pzq24\") pod \"e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") " pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.672494 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.672460    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:11.813217 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.813189    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"]
Jul 22 21:36:11.814870 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:36:11.814840    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddadb0e78_b9df_4c06_bb49_6f5fb1dde81b.slice/crio-f7ac6cfbe357ea000d701e008498aa451033a976e4aa3d29f1fd938a762cbd34 WatchSource:0}: Error finding container f7ac6cfbe357ea000d701e008498aa451033a976e4aa3d29f1fd938a762cbd34: Status 404 returned error can't find the container with id f7ac6cfbe357ea000d701e008498aa451033a976e4aa3d29f1fd938a762cbd34
Jul 22 21:36:11.816995 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.816966    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:36:11.817133 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.817046    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:36:11.817133 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:11.817091    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:36:12.222710 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:12.222673    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh" event={"ID":"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b","Type":"ContainerStarted","Data":"e450d51521526b5db4f77c21bd532e214bb365a2b0dd71b093cf09bfee1f0748"}
Jul 22 21:36:12.222919 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:12.222734    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh" event={"ID":"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b","Type":"ContainerStarted","Data":"f7ac6cfbe357ea000d701e008498aa451033a976e4aa3d29f1fd938a762cbd34"}
Jul 22 21:36:12.244171 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:12.244104    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh" podStartSLOduration=1.244089684 podStartE2EDuration="1.244089684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:36:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:36:12.242828867 +0000 UTC m=+2370.266867632" watchObservedRunningTime="2026-07-22 21:36:12.244089684 +0000 UTC m=+2370.268128263"
Jul 22 21:36:12.672613 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:12.672578    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:12.677229 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:12.677201    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:13.227572 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:13.227538    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:13.228633 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:13.228613    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:20.188763 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:20.188668    2583 patch_prober.go:28] interesting pod/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 22 21:36:20.188763 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:20.188749    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m" podUID="e792c52e-181d-4850-a4bd-9dd696cde4c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 22 21:36:20.262769 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:20.262721    2583 generic.go:356] "Generic (PLEG): container finished" podID="e792c52e-181d-4850-a4bd-9dd696cde4c7" containerID="d33ff7d47360d201e8db34b9dca3969284430e91bf5606ab43406391d90d5b17" exitCode=0
Jul 22 21:36:20.262963 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:20.262800    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m" event={"ID":"e792c52e-181d-4850-a4bd-9dd696cde4c7","Type":"ContainerDied","Data":"d33ff7d47360d201e8db34b9dca3969284430e91bf5606ab43406391d90d5b17"}
Jul 22 21:36:20.263395 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:20.263370    2583 scope.go:117] "RemoveContainer" containerID="d33ff7d47360d201e8db34b9dca3969284430e91bf5606ab43406391d90d5b17"
Jul 22 21:36:20.265572 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:20.265528    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:36:20.265789 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:20.265765    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:36:20.265934 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:20.265916    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:36:21.272465 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.272418    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m" event={"ID":"e792c52e-181d-4850-a4bd-9dd696cde4c7","Type":"ContainerStarted","Data":"0a6232fca4baa73ce85dec321dad01136958d5ae0cf7832ca0e85a6dce212b98"}
Jul 22 21:36:21.479678 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.479640    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:21.479880 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.479768    2583 patch_prober.go:28] interesting pod/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 22 21:36:21.479880 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.479812    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m" podUID="e792c52e-181d-4850-a4bd-9dd696cde4c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 22 21:36:21.507134 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.497016    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"]
Jul 22 21:36:21.507134 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.503968    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:36:21.509791 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.509766    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2f9a91\"/\"default-dockercfg-kwkl8\""
Jul 22 21:36:21.513798 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.511396    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2f9a91\"/\"openshift-service-ca.crt\""
Jul 22 21:36:21.513798 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.511431    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2f9a91\"/\"kube-root-ca.crt\""
Jul 22 21:36:21.513798 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.512929    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"]
Jul 22 21:36:21.516261 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.514931    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2f9a91\"/\"test-model-2f9a91-kserve-self-signed-certs\""
Jul 22 21:36:21.609953 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.609915    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-dshm\") pod \"test-model-2f9a91-kserve-6f4f6f6dd9-cqdth\" (UID: \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\") " pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:36:21.610147 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.609968    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-tmp-dir\") pod \"test-model-2f9a91-kserve-6f4f6f6dd9-cqdth\" (UID: \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\") " pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:36:21.610147 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.610004    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-model-cache\") pod \"test-model-2f9a91-kserve-6f4f6f6dd9-cqdth\" (UID: \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\") " pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:36:21.610147 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.610022    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcpmn\" (UniqueName: \"kubernetes.io/projected/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-kube-api-access-xcpmn\") pod \"test-model-2f9a91-kserve-6f4f6f6dd9-cqdth\" (UID: \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\") " pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:36:21.610147 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.610042    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-home\") pod \"test-model-2f9a91-kserve-6f4f6f6dd9-cqdth\" (UID: \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\") " pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:36:21.610147 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.610067    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-tls-certs\") pod \"test-model-2f9a91-kserve-6f4f6f6dd9-cqdth\" (UID: \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\") " pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:36:21.710815 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.710767    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-model-cache\") pod \"test-model-2f9a91-kserve-6f4f6f6dd9-cqdth\" (UID: \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\") " pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:36:21.710815 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.710814    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcpmn\" (UniqueName: \"kubernetes.io/projected/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-kube-api-access-xcpmn\") pod \"test-model-2f9a91-kserve-6f4f6f6dd9-cqdth\" (UID: \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\") " pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:36:21.711026 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.710849    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-home\") pod \"test-model-2f9a91-kserve-6f4f6f6dd9-cqdth\" (UID: \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\") " pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:36:21.711026 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.710878    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-tls-certs\") pod \"test-model-2f9a91-kserve-6f4f6f6dd9-cqdth\" (UID: \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\") " pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:36:21.711026 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.710955    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-dshm\") pod \"test-model-2f9a91-kserve-6f4f6f6dd9-cqdth\" (UID: \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\") " pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:36:21.711026 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.711007    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-tmp-dir\") pod \"test-model-2f9a91-kserve-6f4f6f6dd9-cqdth\" (UID: \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\") " pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:36:21.711306 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.711283    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-model-cache\") pod \"test-model-2f9a91-kserve-6f4f6f6dd9-cqdth\" (UID: \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\") " pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:36:21.711345 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.711321    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-tmp-dir\") pod \"test-model-2f9a91-kserve-6f4f6f6dd9-cqdth\" (UID: \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\") " pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:36:21.711546 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.711528    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-home\") pod \"test-model-2f9a91-kserve-6f4f6f6dd9-cqdth\" (UID: \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\") " pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:36:21.713752 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.713732    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-dshm\") pod \"test-model-2f9a91-kserve-6f4f6f6dd9-cqdth\" (UID: \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\") " pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:36:21.713882 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.713863    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-tls-certs\") pod \"test-model-2f9a91-kserve-6f4f6f6dd9-cqdth\" (UID: \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\") " pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:36:21.719623 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.719606    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcpmn\" (UniqueName: \"kubernetes.io/projected/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-kube-api-access-xcpmn\") pod \"test-model-2f9a91-kserve-6f4f6f6dd9-cqdth\" (UID: \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\") " pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:36:21.818956 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:21.818743    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:36:22.050864 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:22.050833    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"]
Jul 22 21:36:22.053334 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:36:22.053300    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc54c2c1b_0b44_4a9c_a76d_f4f660980ac5.slice/crio-fee9de36b28663c36388e5aa468f9ee23f76e46a5f2936a92f980c3bff1eaa4d WatchSource:0}: Error finding container fee9de36b28663c36388e5aa468f9ee23f76e46a5f2936a92f980c3bff1eaa4d: Status 404 returned error can't find the container with id fee9de36b28663c36388e5aa468f9ee23f76e46a5f2936a92f980c3bff1eaa4d
Jul 22 21:36:22.282678 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:22.282526    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth" event={"ID":"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5","Type":"ContainerStarted","Data":"4f59dc35722eced56699bb2aa5b9d041e9fdd333896bf72e3e33b0c2ab4f8730"}
Jul 22 21:36:22.282678 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:22.282579    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth" event={"ID":"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5","Type":"ContainerStarted","Data":"fee9de36b28663c36388e5aa468f9ee23f76e46a5f2936a92f980c3bff1eaa4d"}
Jul 22 21:36:22.302543 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:22.302473    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth" podStartSLOduration=1.3024521230000001 podStartE2EDuration="1.302452123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:36:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:36:22.301043535 +0000 UTC m=+2380.325082114" watchObservedRunningTime="2026-07-22 21:36:22.302452123 +0000 UTC m=+2380.326490704"
Jul 22 21:36:22.479557 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:22.479503    2583 patch_prober.go:28] interesting pod/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 22 21:36:22.479766 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:22.479577    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m" podUID="e792c52e-181d-4850-a4bd-9dd696cde4c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 22 21:36:23.479822 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:23.479779    2583 patch_prober.go:28] interesting pod/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 22 21:36:23.480322 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:23.479851    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m" podUID="e792c52e-181d-4850-a4bd-9dd696cde4c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 22 21:36:24.479368 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:24.479329    2583 patch_prober.go:28] interesting pod/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 22 21:36:24.479672 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:24.479637    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m" podUID="e792c52e-181d-4850-a4bd-9dd696cde4c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 22 21:36:25.482835 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:25.482802    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:25.483230 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:25.483088    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:25.483837 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:25.483815    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:36:26.305091 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:26.304980    2583 generic.go:356] "Generic (PLEG): container finished" podID="dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" containerID="e450d51521526b5db4f77c21bd532e214bb365a2b0dd71b093cf09bfee1f0748" exitCode=0
Jul 22 21:36:26.305091 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:26.305060    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh" event={"ID":"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b","Type":"ContainerDied","Data":"e450d51521526b5db4f77c21bd532e214bb365a2b0dd71b093cf09bfee1f0748"}
Jul 22 21:36:26.305596 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:26.305580    2583 scope.go:117] "RemoveContainer" containerID="e450d51521526b5db4f77c21bd532e214bb365a2b0dd71b093cf09bfee1f0748"
Jul 22 21:36:26.306549 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:26.306526    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:36:26.306624 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:26.306590    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:36:26.306624 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:26.306621    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:36:27.311166 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:27.311104    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh" event={"ID":"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b","Type":"ContainerStarted","Data":"a97621e2b182418cc38acffa239f0e785104b174ad5fed72011657d6f44b1e4c"}
Jul 22 21:36:27.673291 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:27.673246    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:27.674428 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:27.674391    2583 patch_prober.go:28] interesting pod/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 22 21:36:27.674577 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:27.674452    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh" podUID="dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 22 21:36:28.228122 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:28.228070    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:28.672900 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:28.672862    2583 patch_prober.go:28] interesting pod/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 22 21:36:28.673455 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:28.672939    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh" podUID="dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 22 21:36:29.673901 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:29.673862    2583 patch_prober.go:28] interesting pod/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 22 21:36:29.674528 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:29.674495    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh" podUID="dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 22 21:36:30.673380 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:30.673335    2583 patch_prober.go:28] interesting pod/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 22 21:36:30.673664 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:30.673632    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh" podUID="dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 22 21:36:31.673801 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:31.673339    2583 patch_prober.go:28] interesting pod/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 22 21:36:31.673801 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:31.673403    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh" podUID="dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 22 21:36:31.819872 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:31.819836    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:36:31.820088 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:31.819899    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:36:31.832459 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:31.832432    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:36:32.345839 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:32.345811    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:36:32.677004 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:32.676913    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:36:32.678087 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:36:32.678070    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:37:28.414469 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:28.414435    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"]
Jul 22 21:37:29.596707 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:29.596670    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2f9a91-lppvc"]
Jul 22 21:37:29.600414 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:29.600396    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2f9a91-lppvc"
Jul 22 21:37:29.602784 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:29.602759    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zz5vc\""
Jul 22 21:37:29.608252 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:29.607805    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2f9a91-lppvc"]
Jul 22 21:37:29.730949 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:29.730922    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac828dbd-995f-4104-815d-117eef7c66bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-2f9a91-lppvc\" (UID: \"ac828dbd-995f-4104-815d-117eef7c66bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2f9a91-lppvc"
Jul 22 21:37:29.832273 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:29.832249    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac828dbd-995f-4104-815d-117eef7c66bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-2f9a91-lppvc\" (UID: \"ac828dbd-995f-4104-815d-117eef7c66bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2f9a91-lppvc"
Jul 22 21:37:29.832841 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:29.832824    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac828dbd-995f-4104-815d-117eef7c66bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-2f9a91-lppvc\" (UID: \"ac828dbd-995f-4104-815d-117eef7c66bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2f9a91-lppvc"
Jul 22 21:37:29.912664 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:29.912606    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2f9a91-lppvc"
Jul 22 21:37:30.040306 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:30.040248    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2f9a91-lppvc"]
Jul 22 21:37:30.042601 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:37:30.042571    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac828dbd_995f_4104_815d_117eef7c66bf.slice/crio-005658cc0aef32baf4f4e33704f0ee59b4d243fb6501550923a03e8239541e00 WatchSource:0}: Error finding container 005658cc0aef32baf4f4e33704f0ee59b4d243fb6501550923a03e8239541e00: Status 404 returned error can't find the container with id 005658cc0aef32baf4f4e33704f0ee59b4d243fb6501550923a03e8239541e00
Jul 22 21:37:30.606312 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:30.606281    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2f9a91-lppvc" event={"ID":"ac828dbd-995f-4104-815d-117eef7c66bf","Type":"ContainerStarted","Data":"2d4077497a73abf651870f03e19d158be1f75c5d087d0f1846beff856e18da96"}
Jul 22 21:37:30.606641 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:30.606336    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2f9a91-lppvc" event={"ID":"ac828dbd-995f-4104-815d-117eef7c66bf","Type":"ContainerStarted","Data":"005658cc0aef32baf4f4e33704f0ee59b4d243fb6501550923a03e8239541e00"}
Jul 22 21:37:30.621173 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:30.621128    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2f9a91-lppvc" podStartSLOduration=1.621095125 podStartE2EDuration="1.621095125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:37:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:37:30.620892816 +0000 UTC m=+2448.644931395" watchObservedRunningTime="2026-07-22 21:37:30.621095125 +0000 UTC m=+2448.645133751"
Jul 22 21:37:31.612955 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:31.612920    2583 generic.go:356] "Generic (PLEG): container finished" podID="ac828dbd-995f-4104-815d-117eef7c66bf" containerID="2d4077497a73abf651870f03e19d158be1f75c5d087d0f1846beff856e18da96" exitCode=0
Jul 22 21:37:31.613385 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:31.613008    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2f9a91-lppvc" event={"ID":"ac828dbd-995f-4104-815d-117eef7c66bf","Type":"ContainerDied","Data":"2d4077497a73abf651870f03e19d158be1f75c5d087d0f1846beff856e18da96"}
Jul 22 21:37:32.749068 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:32.749048    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2f9a91-lppvc"
Jul 22 21:37:32.859228 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:32.859204    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac828dbd-995f-4104-815d-117eef7c66bf-maas-api-service-ca\") pod \"ac828dbd-995f-4104-815d-117eef7c66bf\" (UID: \"ac828dbd-995f-4104-815d-117eef7c66bf\") "
Jul 22 21:37:32.859579 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:32.859557    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac828dbd-995f-4104-815d-117eef7c66bf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ac828dbd-995f-4104-815d-117eef7c66bf" (UID: "ac828dbd-995f-4104-815d-117eef7c66bf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:37:32.959976 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:32.959908    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac828dbd-995f-4104-815d-117eef7c66bf-maas-api-service-ca\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:37:33.624194 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:33.624162    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2f9a91-lppvc" event={"ID":"ac828dbd-995f-4104-815d-117eef7c66bf","Type":"ContainerDied","Data":"005658cc0aef32baf4f4e33704f0ee59b4d243fb6501550923a03e8239541e00"}
Jul 22 21:37:33.624358 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:33.624213    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="005658cc0aef32baf4f4e33704f0ee59b4d243fb6501550923a03e8239541e00"
Jul 22 21:37:33.624358 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:33.624171    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2f9a91-lppvc"
Jul 22 21:37:43.434573 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:43.434534    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth" podUID="c54c2c1b-0b44-4a9c-a76d-f4f660980ac5" containerName="main" containerID="cri-o://4f59dc35722eced56699bb2aa5b9d041e9fdd333896bf72e3e33b0c2ab4f8730" gracePeriod=45
Jul 22 21:37:43.671173 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:43.671146    2583 generic.go:356] "Generic (PLEG): container finished" podID="c54c2c1b-0b44-4a9c-a76d-f4f660980ac5" containerID="4f59dc35722eced56699bb2aa5b9d041e9fdd333896bf72e3e33b0c2ab4f8730" exitCode=0
Jul 22 21:37:43.671325 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:43.671218    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth" event={"ID":"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5","Type":"ContainerDied","Data":"4f59dc35722eced56699bb2aa5b9d041e9fdd333896bf72e3e33b0c2ab4f8730"}
Jul 22 21:37:43.696575 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:43.696516    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:37:43.850315 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:43.850293    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-dshm\") pod \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\" (UID: \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\") "
Jul 22 21:37:43.850444 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:43.850320    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-tmp-dir\") pod \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\" (UID: \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\") "
Jul 22 21:37:43.850444 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:43.850391    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-home\") pod \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\" (UID: \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\") "
Jul 22 21:37:43.850444 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:43.850424    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcpmn\" (UniqueName: \"kubernetes.io/projected/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-kube-api-access-xcpmn\") pod \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\" (UID: \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\") "
Jul 22 21:37:43.850598 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:43.850445    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-tls-certs\") pod \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\" (UID: \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\") "
Jul 22 21:37:43.850598 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:43.850464    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-model-cache\") pod \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\" (UID: \"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5\") "
Jul 22 21:37:43.850708 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:43.850644    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c54c2c1b-0b44-4a9c-a76d-f4f660980ac5" (UID: "c54c2c1b-0b44-4a9c-a76d-f4f660980ac5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:37:43.850708 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:43.850690    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-home" (OuterVolumeSpecName: "home") pod "c54c2c1b-0b44-4a9c-a76d-f4f660980ac5" (UID: "c54c2c1b-0b44-4a9c-a76d-f4f660980ac5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:37:43.850808 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:43.850782    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-model-cache" (OuterVolumeSpecName: "model-cache") pod "c54c2c1b-0b44-4a9c-a76d-f4f660980ac5" (UID: "c54c2c1b-0b44-4a9c-a76d-f4f660980ac5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:37:43.852735 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:43.852705    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-kube-api-access-xcpmn" (OuterVolumeSpecName: "kube-api-access-xcpmn") pod "c54c2c1b-0b44-4a9c-a76d-f4f660980ac5" (UID: "c54c2c1b-0b44-4a9c-a76d-f4f660980ac5"). InnerVolumeSpecName "kube-api-access-xcpmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:37:43.852840 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:43.852742    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c54c2c1b-0b44-4a9c-a76d-f4f660980ac5" (UID: "c54c2c1b-0b44-4a9c-a76d-f4f660980ac5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:37:43.852840 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:43.852750    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-dshm" (OuterVolumeSpecName: "dshm") pod "c54c2c1b-0b44-4a9c-a76d-f4f660980ac5" (UID: "c54c2c1b-0b44-4a9c-a76d-f4f660980ac5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:37:43.951302 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:43.951235    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-home\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:37:43.951302 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:43.951268    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcpmn\" (UniqueName: \"kubernetes.io/projected/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-kube-api-access-xcpmn\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:37:43.951302 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:43.951279    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-tls-certs\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:37:43.951302 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:43.951287    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-model-cache\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:37:43.951302 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:43.951295    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-dshm\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:37:43.951302 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:43.951302    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5-tmp-dir\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:37:44.675218 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:44.675158    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2f9a91-lppvc"]
Jul 22 21:37:44.677793 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:44.677764    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"
Jul 22 21:37:44.677916 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:44.677764    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth" event={"ID":"c54c2c1b-0b44-4a9c-a76d-f4f660980ac5","Type":"ContainerDied","Data":"fee9de36b28663c36388e5aa468f9ee23f76e46a5f2936a92f980c3bff1eaa4d"}
Jul 22 21:37:44.677916 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:44.677911    2583 scope.go:117] "RemoveContainer" containerID="4f59dc35722eced56699bb2aa5b9d041e9fdd333896bf72e3e33b0c2ab4f8730"
Jul 22 21:37:44.680052 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:44.680029    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2f9a91-lppvc"]
Jul 22 21:37:44.693940 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:44.693916    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"]
Jul 22 21:37:44.700235 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:44.700215    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-2f9a91/test-model-2f9a91-kserve-6f4f6f6dd9-cqdth"]
Jul 22 21:37:46.409186 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:46.409148    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac828dbd-995f-4104-815d-117eef7c66bf" path="/var/lib/kubelet/pods/ac828dbd-995f-4104-815d-117eef7c66bf/volumes"
Jul 22 21:37:46.409555 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:46.409535    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c54c2c1b-0b44-4a9c-a76d-f4f660980ac5" path="/var/lib/kubelet/pods/c54c2c1b-0b44-4a9c-a76d-f4f660980ac5/volumes"
Jul 22 21:37:51.290543 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:51.290509    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"]
Jul 22 21:37:51.290939 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:51.290719    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m" podUID="e792c52e-181d-4850-a4bd-9dd696cde4c7" containerName="istio-proxy" containerID="cri-o://0a6232fca4baa73ce85dec321dad01136958d5ae0cf7832ca0e85a6dce212b98" gracePeriod=30
Jul 22 21:37:51.624843 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:51.624809    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dd516-lvxhq"]
Jul 22 21:37:51.625160 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:51.625147    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac828dbd-995f-4104-815d-117eef7c66bf" containerName="revoke-keys"
Jul 22 21:37:51.625209 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:51.625162    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac828dbd-995f-4104-815d-117eef7c66bf" containerName="revoke-keys"
Jul 22 21:37:51.625209 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:51.625179    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c54c2c1b-0b44-4a9c-a76d-f4f660980ac5" containerName="main"
Jul 22 21:37:51.625209 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:51.625185    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c54c2c1b-0b44-4a9c-a76d-f4f660980ac5" containerName="main"
Jul 22 21:37:51.625302 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:51.625240    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac828dbd-995f-4104-815d-117eef7c66bf" containerName="revoke-keys"
Jul 22 21:37:51.625302 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:51.625250    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c54c2c1b-0b44-4a9c-a76d-f4f660980ac5" containerName="main"
Jul 22 21:37:51.628233 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:51.628212    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dd516-lvxhq"
Jul 22 21:37:51.636130 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:51.630948    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zz5vc\""
Jul 22 21:37:51.636349 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:51.636320    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dd516-lvxhq"]
Jul 22 21:37:51.714749 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:51.714718    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a14cde5c-47b9-4ce7-a903-d4eda7540851-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1dd516-lvxhq\" (UID: \"a14cde5c-47b9-4ce7-a903-d4eda7540851\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dd516-lvxhq"
Jul 22 21:37:51.815267 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:51.815238    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a14cde5c-47b9-4ce7-a903-d4eda7540851-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1dd516-lvxhq\" (UID: \"a14cde5c-47b9-4ce7-a903-d4eda7540851\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dd516-lvxhq"
Jul 22 21:37:51.815873 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:51.815853    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a14cde5c-47b9-4ce7-a903-d4eda7540851-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1dd516-lvxhq\" (UID: \"a14cde5c-47b9-4ce7-a903-d4eda7540851\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dd516-lvxhq"
Jul 22 21:37:51.946663 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:51.946576    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dd516-lvxhq"
Jul 22 21:37:52.096183 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:52.096125    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dd516-lvxhq"]
Jul 22 21:37:52.098430 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:37:52.098394    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda14cde5c_47b9_4ce7_a903_d4eda7540851.slice/crio-60f61e77c8815e59138d379ccdb1a063f59a3c7416d55e9d15c163cefebaef3e WatchSource:0}: Error finding container 60f61e77c8815e59138d379ccdb1a063f59a3c7416d55e9d15c163cefebaef3e: Status 404 returned error can't find the container with id 60f61e77c8815e59138d379ccdb1a063f59a3c7416d55e9d15c163cefebaef3e
Jul 22 21:37:52.716279 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:52.716243    2583 generic.go:356] "Generic (PLEG): container finished" podID="a14cde5c-47b9-4ce7-a903-d4eda7540851" containerID="672db0856c861fc45acd635e23c5adb26faa1a627b79ab4895891d0d8c6a5560" exitCode=0
Jul 22 21:37:52.716590 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:52.716304    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dd516-lvxhq" event={"ID":"a14cde5c-47b9-4ce7-a903-d4eda7540851","Type":"ContainerDied","Data":"672db0856c861fc45acd635e23c5adb26faa1a627b79ab4895891d0d8c6a5560"}
Jul 22 21:37:52.716590 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:52.716359    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dd516-lvxhq" event={"ID":"a14cde5c-47b9-4ce7-a903-d4eda7540851","Type":"ContainerStarted","Data":"60f61e77c8815e59138d379ccdb1a063f59a3c7416d55e9d15c163cefebaef3e"}
Jul 22 21:37:53.845568 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:53.845545    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dd516-lvxhq"
Jul 22 21:37:53.932534 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:53.932511    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a14cde5c-47b9-4ce7-a903-d4eda7540851-maas-api-service-ca\") pod \"a14cde5c-47b9-4ce7-a903-d4eda7540851\" (UID: \"a14cde5c-47b9-4ce7-a903-d4eda7540851\") "
Jul 22 21:37:53.932846 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:53.932827    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a14cde5c-47b9-4ce7-a903-d4eda7540851-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a14cde5c-47b9-4ce7-a903-d4eda7540851" (UID: "a14cde5c-47b9-4ce7-a903-d4eda7540851"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:37:54.033399 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:54.033340    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a14cde5c-47b9-4ce7-a903-d4eda7540851-maas-api-service-ca\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:37:54.726363 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:54.726280    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dd516-lvxhq" event={"ID":"a14cde5c-47b9-4ce7-a903-d4eda7540851","Type":"ContainerDied","Data":"60f61e77c8815e59138d379ccdb1a063f59a3c7416d55e9d15c163cefebaef3e"}
Jul 22 21:37:54.726363 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:54.726300    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dd516-lvxhq"
Jul 22 21:37:54.726363 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:54.726328    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60f61e77c8815e59138d379ccdb1a063f59a3c7416d55e9d15c163cefebaef3e"
Jul 22 21:37:55.485459 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:55.485421    2583 patch_prober.go:28] interesting pod/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 21:37:55.485830 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:55.485484    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m" podUID="e792c52e-181d-4850-a4bd-9dd696cde4c7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 21:37:56.557786 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.557733    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:37:56.654672 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.654643    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-workload-certs\") pod \"e792c52e-181d-4850-a4bd-9dd696cde4c7\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") "
Jul 22 21:37:56.654800 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.654691    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-istio-data\") pod \"e792c52e-181d-4850-a4bd-9dd696cde4c7\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") "
Jul 22 21:37:56.654800 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.654712    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6bwm\" (UniqueName: \"kubernetes.io/projected/e792c52e-181d-4850-a4bd-9dd696cde4c7-kube-api-access-x6bwm\") pod \"e792c52e-181d-4850-a4bd-9dd696cde4c7\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") "
Jul 22 21:37:56.654800 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.654748    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e792c52e-181d-4850-a4bd-9dd696cde4c7-istio-token\") pod \"e792c52e-181d-4850-a4bd-9dd696cde4c7\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") "
Jul 22 21:37:56.654800 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.654767    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-istio-envoy\") pod \"e792c52e-181d-4850-a4bd-9dd696cde4c7\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") "
Jul 22 21:37:56.654800 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.654785    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-credential-socket\") pod \"e792c52e-181d-4850-a4bd-9dd696cde4c7\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") "
Jul 22 21:37:56.655037 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.654830    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-workload-socket\") pod \"e792c52e-181d-4850-a4bd-9dd696cde4c7\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") "
Jul 22 21:37:56.655037 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.654864    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e792c52e-181d-4850-a4bd-9dd696cde4c7-istio-podinfo\") pod \"e792c52e-181d-4850-a4bd-9dd696cde4c7\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") "
Jul 22 21:37:56.655037 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.654887    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e792c52e-181d-4850-a4bd-9dd696cde4c7-istiod-ca-cert\") pod \"e792c52e-181d-4850-a4bd-9dd696cde4c7\" (UID: \"e792c52e-181d-4850-a4bd-9dd696cde4c7\") "
Jul 22 21:37:56.655037 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.654946    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e792c52e-181d-4850-a4bd-9dd696cde4c7" (UID: "e792c52e-181d-4850-a4bd-9dd696cde4c7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:37:56.655290 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.655184    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-workload-certs\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:37:56.655290 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.655178    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e792c52e-181d-4850-a4bd-9dd696cde4c7" (UID: "e792c52e-181d-4850-a4bd-9dd696cde4c7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:37:56.655398 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.655374    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e792c52e-181d-4850-a4bd-9dd696cde4c7" (UID: "e792c52e-181d-4850-a4bd-9dd696cde4c7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:37:56.655513 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.655455    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e792c52e-181d-4850-a4bd-9dd696cde4c7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e792c52e-181d-4850-a4bd-9dd696cde4c7" (UID: "e792c52e-181d-4850-a4bd-9dd696cde4c7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:37:56.655783 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.655757    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-istio-data" (OuterVolumeSpecName: "istio-data") pod "e792c52e-181d-4850-a4bd-9dd696cde4c7" (UID: "e792c52e-181d-4850-a4bd-9dd696cde4c7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:37:56.657091 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.657062    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e792c52e-181d-4850-a4bd-9dd696cde4c7" (UID: "e792c52e-181d-4850-a4bd-9dd696cde4c7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:37:56.657370 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.657350    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e792c52e-181d-4850-a4bd-9dd696cde4c7-kube-api-access-x6bwm" (OuterVolumeSpecName: "kube-api-access-x6bwm") pod "e792c52e-181d-4850-a4bd-9dd696cde4c7" (UID: "e792c52e-181d-4850-a4bd-9dd696cde4c7"). InnerVolumeSpecName "kube-api-access-x6bwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:37:56.657580 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.657561    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e792c52e-181d-4850-a4bd-9dd696cde4c7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e792c52e-181d-4850-a4bd-9dd696cde4c7" (UID: "e792c52e-181d-4850-a4bd-9dd696cde4c7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 21:37:56.657580 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.657567    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e792c52e-181d-4850-a4bd-9dd696cde4c7-istio-token" (OuterVolumeSpecName: "istio-token") pod "e792c52e-181d-4850-a4bd-9dd696cde4c7" (UID: "e792c52e-181d-4850-a4bd-9dd696cde4c7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:37:56.736820 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.736791    2583 generic.go:356] "Generic (PLEG): container finished" podID="e792c52e-181d-4850-a4bd-9dd696cde4c7" containerID="0a6232fca4baa73ce85dec321dad01136958d5ae0cf7832ca0e85a6dce212b98" exitCode=0
Jul 22 21:37:56.736901 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.736837    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"
Jul 22 21:37:56.736901 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.736850    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m" event={"ID":"e792c52e-181d-4850-a4bd-9dd696cde4c7","Type":"ContainerDied","Data":"0a6232fca4baa73ce85dec321dad01136958d5ae0cf7832ca0e85a6dce212b98"}
Jul 22 21:37:56.736981 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.736905    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m" event={"ID":"e792c52e-181d-4850-a4bd-9dd696cde4c7","Type":"ContainerDied","Data":"f3eeb4e28761859846fd0fb220a7ad36a9186f2577b949fd59c9bec9a1108a33"}
Jul 22 21:37:56.736981 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.736919    2583 scope.go:117] "RemoveContainer" containerID="0a6232fca4baa73ce85dec321dad01136958d5ae0cf7832ca0e85a6dce212b98"
Jul 22 21:37:56.750888 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.750860    2583 scope.go:117] "RemoveContainer" containerID="d33ff7d47360d201e8db34b9dca3969284430e91bf5606ab43406391d90d5b17"
Jul 22 21:37:56.756405 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.756384    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-istio-data\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:37:56.756487 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.756407    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6bwm\" (UniqueName: \"kubernetes.io/projected/e792c52e-181d-4850-a4bd-9dd696cde4c7-kube-api-access-x6bwm\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:37:56.756487 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.756417    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e792c52e-181d-4850-a4bd-9dd696cde4c7-istio-token\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:37:56.756487 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.756426    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-istio-envoy\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:37:56.756487 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.756433    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-credential-socket\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:37:56.756487 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.756441    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e792c52e-181d-4850-a4bd-9dd696cde4c7-workload-socket\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:37:56.756487 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.756448    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e792c52e-181d-4850-a4bd-9dd696cde4c7-istio-podinfo\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:37:56.756487 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.756456    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e792c52e-181d-4850-a4bd-9dd696cde4c7-istiod-ca-cert\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:37:56.759409 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.759305    2583 scope.go:117] "RemoveContainer" containerID="0a6232fca4baa73ce85dec321dad01136958d5ae0cf7832ca0e85a6dce212b98"
Jul 22 21:37:56.759724 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:37:56.759693    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a6232fca4baa73ce85dec321dad01136958d5ae0cf7832ca0e85a6dce212b98\": container with ID starting with 0a6232fca4baa73ce85dec321dad01136958d5ae0cf7832ca0e85a6dce212b98 not found: ID does not exist" containerID="0a6232fca4baa73ce85dec321dad01136958d5ae0cf7832ca0e85a6dce212b98"
Jul 22 21:37:56.759839 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.759734    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a6232fca4baa73ce85dec321dad01136958d5ae0cf7832ca0e85a6dce212b98"} err="failed to get container status \"0a6232fca4baa73ce85dec321dad01136958d5ae0cf7832ca0e85a6dce212b98\": rpc error: code = NotFound desc = could not find container \"0a6232fca4baa73ce85dec321dad01136958d5ae0cf7832ca0e85a6dce212b98\": container with ID starting with 0a6232fca4baa73ce85dec321dad01136958d5ae0cf7832ca0e85a6dce212b98 not found: ID does not exist"
Jul 22 21:37:56.759839 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.759757    2583 scope.go:117] "RemoveContainer" containerID="d33ff7d47360d201e8db34b9dca3969284430e91bf5606ab43406391d90d5b17"
Jul 22 21:37:56.760048 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:37:56.760030    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d33ff7d47360d201e8db34b9dca3969284430e91bf5606ab43406391d90d5b17\": container with ID starting with d33ff7d47360d201e8db34b9dca3969284430e91bf5606ab43406391d90d5b17 not found: ID does not exist" containerID="d33ff7d47360d201e8db34b9dca3969284430e91bf5606ab43406391d90d5b17"
Jul 22 21:37:56.760104 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.760057    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d33ff7d47360d201e8db34b9dca3969284430e91bf5606ab43406391d90d5b17"} err="failed to get container status \"d33ff7d47360d201e8db34b9dca3969284430e91bf5606ab43406391d90d5b17\": rpc error: code = NotFound desc = could not find container \"d33ff7d47360d201e8db34b9dca3969284430e91bf5606ab43406391d90d5b17\": container with ID starting with d33ff7d47360d201e8db34b9dca3969284430e91bf5606ab43406391d90d5b17 not found: ID does not exist"
Jul 22 21:37:56.760993 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.760976    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"]
Jul 22 21:37:56.765598 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:56.765576    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-2f9a91-openshift-default-7dd9d9586f-7cm5m"]
Jul 22 21:37:58.410311 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:37:58.410278    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e792c52e-181d-4850-a4bd-9dd696cde4c7" path="/var/lib/kubelet/pods/e792c52e-181d-4850-a4bd-9dd696cde4c7/volumes"
Jul 22 21:38:06.708555 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:06.708515    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dd516-lvxhq"]
Jul 22 21:38:06.711852 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:06.711821    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dd516-lvxhq"]
Jul 22 21:38:08.409646 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:08.409610    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a14cde5c-47b9-4ce7-a903-d4eda7540851" path="/var/lib/kubelet/pods/a14cde5c-47b9-4ce7-a903-d4eda7540851/volumes"
Jul 22 21:38:13.098230 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:13.098198    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"]
Jul 22 21:38:13.098657 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:13.098406    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh" podUID="dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" containerName="istio-proxy" containerID="cri-o://a97621e2b182418cc38acffa239f0e785104b174ad5fed72011657d6f44b1e4c" gracePeriod=30
Jul 22 21:38:14.034841 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.034805    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"]
Jul 22 21:38:14.035177 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.035162    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a14cde5c-47b9-4ce7-a903-d4eda7540851" containerName="revoke-keys"
Jul 22 21:38:14.035239 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.035178    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a14cde5c-47b9-4ce7-a903-d4eda7540851" containerName="revoke-keys"
Jul 22 21:38:14.035239 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.035192    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e792c52e-181d-4850-a4bd-9dd696cde4c7" containerName="istio-proxy"
Jul 22 21:38:14.035239 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.035198    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e792c52e-181d-4850-a4bd-9dd696cde4c7" containerName="istio-proxy"
Jul 22 21:38:14.035239 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.035205    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e792c52e-181d-4850-a4bd-9dd696cde4c7" containerName="istio-proxy"
Jul 22 21:38:14.035239 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.035210    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e792c52e-181d-4850-a4bd-9dd696cde4c7" containerName="istio-proxy"
Jul 22 21:38:14.035409 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.035276    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a14cde5c-47b9-4ce7-a903-d4eda7540851" containerName="revoke-keys"
Jul 22 21:38:14.035409 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.035283    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e792c52e-181d-4850-a4bd-9dd696cde4c7" containerName="istio-proxy"
Jul 22 21:38:14.035409 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.035290    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e792c52e-181d-4850-a4bd-9dd696cde4c7" containerName="istio-proxy"
Jul 22 21:38:14.039594 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.039575    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.041696 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.041664    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-5d7596-openshift-default-dockercfg-hmhnb\""
Jul 22 21:38:14.054390 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.054370    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"]
Jul 22 21:38:14.093493 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.093466    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/569bee75-010b-48aa-a2ca-bea8f1753911-istio-podinfo\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.093606 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.093505    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-workload-socket\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.093606 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.093535    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/569bee75-010b-48aa-a2ca-bea8f1753911-istio-token\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.093606 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.093594    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/569bee75-010b-48aa-a2ca-bea8f1753911-istiod-ca-cert\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.093725 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.093633    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-credential-socket\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.093725 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.093654    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-workload-certs\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.093725 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.093695    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92mqc\" (UniqueName: \"kubernetes.io/projected/569bee75-010b-48aa-a2ca-bea8f1753911-kube-api-access-92mqc\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.093819 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.093730    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-istio-data\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.093819 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.093790    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-istio-envoy\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.194185 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.194158    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/569bee75-010b-48aa-a2ca-bea8f1753911-istio-token\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.194185 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.194196    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/569bee75-010b-48aa-a2ca-bea8f1753911-istiod-ca-cert\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.194677 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.194217    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-credential-socket\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.194677 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.194239    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-workload-certs\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.194677 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.194283    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92mqc\" (UniqueName: \"kubernetes.io/projected/569bee75-010b-48aa-a2ca-bea8f1753911-kube-api-access-92mqc\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.194677 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.194318    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-istio-data\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.194677 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.194363    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-istio-envoy\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.194677 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.194406    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/569bee75-010b-48aa-a2ca-bea8f1753911-istio-podinfo\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.194677 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.194451    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-workload-socket\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.194677 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.194625    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-credential-socket\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.194677 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.194674    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-workload-certs\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.195506 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.194782    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-workload-socket\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.195506 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.194859    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-istio-data\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.195506 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.194989    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/569bee75-010b-48aa-a2ca-bea8f1753911-istiod-ca-cert\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.196857 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.196834    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-istio-envoy\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.197273 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.197253    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/569bee75-010b-48aa-a2ca-bea8f1753911-istio-podinfo\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.203282 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.203260    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/569bee75-010b-48aa-a2ca-bea8f1753911-istio-token\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.203496 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.203475    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92mqc\" (UniqueName: \"kubernetes.io/projected/569bee75-010b-48aa-a2ca-bea8f1753911-kube-api-access-92mqc\") pod \"e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") " pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.349620 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.349592    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:14.485303 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.485274    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"]
Jul 22 21:38:14.486752 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:38:14.486728    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod569bee75_010b_48aa_a2ca_bea8f1753911.slice/crio-ea2f2d5328b528609db93c7c5929d3fa8083dd6a9343b72917ac515432f2075f WatchSource:0}: Error finding container ea2f2d5328b528609db93c7c5929d3fa8083dd6a9343b72917ac515432f2075f: Status 404 returned error can't find the container with id ea2f2d5328b528609db93c7c5929d3fa8083dd6a9343b72917ac515432f2075f
Jul 22 21:38:14.488755 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.488723    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:38:14.488847 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.488802    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:38:14.488909 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.488846    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:38:14.824375 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.824296    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7" event={"ID":"569bee75-010b-48aa-a2ca-bea8f1753911","Type":"ContainerStarted","Data":"3cb8541ec614d2a382524935666be51ce1c54bd0e3aa50f54f15ebe398195718"}
Jul 22 21:38:14.824375 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.824348    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7" event={"ID":"569bee75-010b-48aa-a2ca-bea8f1753911","Type":"ContainerStarted","Data":"ea2f2d5328b528609db93c7c5929d3fa8083dd6a9343b72917ac515432f2075f"}
Jul 22 21:38:14.845491 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:14.845444    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7" podStartSLOduration=0.845430378 podStartE2EDuration="845.430378ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:38:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:38:14.843842633 +0000 UTC m=+2492.867881213" watchObservedRunningTime="2026-07-22 21:38:14.845430378 +0000 UTC m=+2492.869468956"
Jul 22 21:38:15.350724 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:15.350692    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:15.355463 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:15.355439    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:15.830282 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:15.830188    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:15.831223 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:15.831199    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:17.679828 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:17.679791    2583 patch_prober.go:28] interesting pod/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 21:38:17.680420 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:17.680382    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh" podUID="dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 21:38:18.342943 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.342920    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:38:18.432715 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.432644    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istio-token\") pod \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") "
Jul 22 21:38:18.432715 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.432676    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istio-envoy\") pod \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") "
Jul 22 21:38:18.432883 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.432721    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-workload-socket\") pod \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") "
Jul 22 21:38:18.432934 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.432913    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-workload-certs\") pod \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") "
Jul 22 21:38:18.432993 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.432967    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzq24\" (UniqueName: \"kubernetes.io/projected/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-kube-api-access-pzq24\") pod \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") "
Jul 22 21:38:18.432993 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.432981    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" (UID: "dadb0e78-b9df-4c06-bb49-6f5fb1dde81b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:38:18.433082 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.432996    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istio-data\") pod \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") "
Jul 22 21:38:18.433160 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.433078    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istio-podinfo\") pod \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") "
Jul 22 21:38:18.433225 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.433157    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istiod-ca-cert\") pod \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") "
Jul 22 21:38:18.433225 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.433206    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-credential-socket\") pod \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\" (UID: \"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b\") "
Jul 22 21:38:18.433326 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.433194    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" (UID: "dadb0e78-b9df-4c06-bb49-6f5fb1dde81b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:38:18.433547 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.433504    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" (UID: "dadb0e78-b9df-4c06-bb49-6f5fb1dde81b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:38:18.433709 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.433684    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-workload-socket\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:38:18.433875 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.433716    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-workload-certs\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:38:18.433875 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.433731    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istiod-ca-cert\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:38:18.433875 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.433819    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istio-data" (OuterVolumeSpecName: "istio-data") pod "dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" (UID: "dadb0e78-b9df-4c06-bb49-6f5fb1dde81b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:38:18.433875 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.433843    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" (UID: "dadb0e78-b9df-4c06-bb49-6f5fb1dde81b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:38:18.435079 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.435050    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istio-token" (OuterVolumeSpecName: "istio-token") pod "dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" (UID: "dadb0e78-b9df-4c06-bb49-6f5fb1dde81b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:38:18.435268 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.435246    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" (UID: "dadb0e78-b9df-4c06-bb49-6f5fb1dde81b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:38:18.435657 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.435638    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-kube-api-access-pzq24" (OuterVolumeSpecName: "kube-api-access-pzq24") pod "dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" (UID: "dadb0e78-b9df-4c06-bb49-6f5fb1dde81b"). InnerVolumeSpecName "kube-api-access-pzq24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:38:18.435738 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.435719    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" (UID: "dadb0e78-b9df-4c06-bb49-6f5fb1dde81b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 21:38:18.534425 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.534389    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istio-token\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:38:18.534425 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.534417    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istio-envoy\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:38:18.534425 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.534427    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzq24\" (UniqueName: \"kubernetes.io/projected/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-kube-api-access-pzq24\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:38:18.534425 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.534437    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istio-data\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:38:18.534687 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.534446    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-istio-podinfo\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:38:18.534687 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.534454    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b-credential-socket\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:38:18.845631 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.845596    2583 generic.go:356] "Generic (PLEG): container finished" podID="dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" containerID="a97621e2b182418cc38acffa239f0e785104b174ad5fed72011657d6f44b1e4c" exitCode=0
Jul 22 21:38:18.846048 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.845650    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"
Jul 22 21:38:18.846048 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.845685    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh" event={"ID":"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b","Type":"ContainerDied","Data":"a97621e2b182418cc38acffa239f0e785104b174ad5fed72011657d6f44b1e4c"}
Jul 22 21:38:18.846048 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.845752    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh" event={"ID":"dadb0e78-b9df-4c06-bb49-6f5fb1dde81b","Type":"ContainerDied","Data":"f7ac6cfbe357ea000d701e008498aa451033a976e4aa3d29f1fd938a762cbd34"}
Jul 22 21:38:18.846048 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.845777    2583 scope.go:117] "RemoveContainer" containerID="a97621e2b182418cc38acffa239f0e785104b174ad5fed72011657d6f44b1e4c"
Jul 22 21:38:18.855367 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.855349    2583 scope.go:117] "RemoveContainer" containerID="e450d51521526b5db4f77c21bd532e214bb365a2b0dd71b093cf09bfee1f0748"
Jul 22 21:38:18.863430 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.863415    2583 scope.go:117] "RemoveContainer" containerID="a97621e2b182418cc38acffa239f0e785104b174ad5fed72011657d6f44b1e4c"
Jul 22 21:38:18.863666 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:38:18.863630    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a97621e2b182418cc38acffa239f0e785104b174ad5fed72011657d6f44b1e4c\": container with ID starting with a97621e2b182418cc38acffa239f0e785104b174ad5fed72011657d6f44b1e4c not found: ID does not exist" containerID="a97621e2b182418cc38acffa239f0e785104b174ad5fed72011657d6f44b1e4c"
Jul 22 21:38:18.863712 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.863673    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a97621e2b182418cc38acffa239f0e785104b174ad5fed72011657d6f44b1e4c"} err="failed to get container status \"a97621e2b182418cc38acffa239f0e785104b174ad5fed72011657d6f44b1e4c\": rpc error: code = NotFound desc = could not find container \"a97621e2b182418cc38acffa239f0e785104b174ad5fed72011657d6f44b1e4c\": container with ID starting with a97621e2b182418cc38acffa239f0e785104b174ad5fed72011657d6f44b1e4c not found: ID does not exist"
Jul 22 21:38:18.863712 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.863687    2583 scope.go:117] "RemoveContainer" containerID="e450d51521526b5db4f77c21bd532e214bb365a2b0dd71b093cf09bfee1f0748"
Jul 22 21:38:18.863932 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:38:18.863914    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e450d51521526b5db4f77c21bd532e214bb365a2b0dd71b093cf09bfee1f0748\": container with ID starting with e450d51521526b5db4f77c21bd532e214bb365a2b0dd71b093cf09bfee1f0748 not found: ID does not exist" containerID="e450d51521526b5db4f77c21bd532e214bb365a2b0dd71b093cf09bfee1f0748"
Jul 22 21:38:18.863986 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.863934    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e450d51521526b5db4f77c21bd532e214bb365a2b0dd71b093cf09bfee1f0748"} err="failed to get container status \"e450d51521526b5db4f77c21bd532e214bb365a2b0dd71b093cf09bfee1f0748\": rpc error: code = NotFound desc = could not find container \"e450d51521526b5db4f77c21bd532e214bb365a2b0dd71b093cf09bfee1f0748\": container with ID starting with e450d51521526b5db4f77c21bd532e214bb365a2b0dd71b093cf09bfee1f0748 not found: ID does not exist"
Jul 22 21:38:18.866662 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.866641    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"]
Jul 22 21:38:18.870503 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:18.870485    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-1dd516-openshift-default-74d54d7649-fjhmh"]
Jul 22 21:38:20.409456 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:20.409423    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" path="/var/lib/kubelet/pods/dadb0e78-b9df-4c06-bb49-6f5fb1dde81b/volumes"
Jul 22 21:38:22.053858 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.053825    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"]
Jul 22 21:38:22.054236 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.054190    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" containerName="istio-proxy"
Jul 22 21:38:22.054236 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.054204    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" containerName="istio-proxy"
Jul 22 21:38:22.054236 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.054216    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" containerName="istio-proxy"
Jul 22 21:38:22.054236 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.054222    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" containerName="istio-proxy"
Jul 22 21:38:22.054372 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.054296    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" containerName="istio-proxy"
Jul 22 21:38:22.054372 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.054305    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dadb0e78-b9df-4c06-bb49-6f5fb1dde81b" containerName="istio-proxy"
Jul 22 21:38:22.058798 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.058778    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.062246 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.062226    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-af2d1d-openshift-default-dockercfg-gv988\""
Jul 22 21:38:22.089428 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.089403    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"]
Jul 22 21:38:22.161748 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.161720    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wv9k\" (UniqueName: \"kubernetes.io/projected/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-kube-api-access-2wv9k\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.161867 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.161753    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-credential-socket\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.161867 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.161772    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istiod-ca-cert\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.161867 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.161798    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istio-podinfo\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.161995 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.161880    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-workload-socket\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.161995 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.161908    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istio-envoy\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.161995 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.161930    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-workload-certs\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.161995 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.161947    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istio-token\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.161995 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.161972    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istio-data\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.262454 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.262431    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wv9k\" (UniqueName: \"kubernetes.io/projected/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-kube-api-access-2wv9k\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.262582 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.262459    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-credential-socket\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.262582 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.262478    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istiod-ca-cert\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.262582 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.262498    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istio-podinfo\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.262756 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.262629    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-workload-socket\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.262756 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.262667    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istio-envoy\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.262756 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.262706    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-workload-certs\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.262756 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.262730    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istio-token\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.262978 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.262756    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istio-data\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.262978 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.262906    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-credential-socket\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.263192 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.263167    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-workload-socket\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.263279 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.263228    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istio-data\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.263279 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.263260    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-workload-certs\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.263491 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.263469    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istiod-ca-cert\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.265197 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.265178    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istio-podinfo\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.265268 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.265255    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istio-envoy\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.272192 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.272172    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istio-token\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.272497 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.272462    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wv9k\" (UniqueName: \"kubernetes.io/projected/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-kube-api-access-2wv9k\") pod \"e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") " pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.368899 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.368875    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:22.501575 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.501546    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"]
Jul 22 21:38:22.503516 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:38:22.503486    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c7632e1_e113_4cfc_b472_f0daeaa9e1f9.slice/crio-66ff5c8c33e2a92af5184a3734b1b39ec12687809b0409a0f9394125e9f286f9 WatchSource:0}: Error finding container 66ff5c8c33e2a92af5184a3734b1b39ec12687809b0409a0f9394125e9f286f9: Status 404 returned error can't find the container with id 66ff5c8c33e2a92af5184a3734b1b39ec12687809b0409a0f9394125e9f286f9
Jul 22 21:38:22.505728 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.505684    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:38:22.505817 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.505768    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:38:22.505817 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.505797    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:38:22.873360 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.873326    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw" event={"ID":"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9","Type":"ContainerStarted","Data":"0af307a12e791d1f1586dea59399907873fd418ecb431216b2cf472af201a7f2"}
Jul 22 21:38:22.873515 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.873389    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw" event={"ID":"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9","Type":"ContainerStarted","Data":"66ff5c8c33e2a92af5184a3734b1b39ec12687809b0409a0f9394125e9f286f9"}
Jul 22 21:38:22.892445 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:22.892397    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw" podStartSLOduration=0.89238277 podStartE2EDuration="892.38277ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:38:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:38:22.892165917 +0000 UTC m=+2500.916204496" watchObservedRunningTime="2026-07-22 21:38:22.89238277 +0000 UTC m=+2500.916421349"
Jul 22 21:38:23.369214 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:23.369177    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:23.374058 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:23.374034    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:23.878433 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:23.878399    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:23.879402 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:23.879381    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:31.871303 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:31.871258    2583 patch_prober.go:28] interesting pod/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 22 21:38:31.871656 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:31.871335    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7" podUID="569bee75-010b-48aa-a2ca-bea8f1753911" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 22 21:38:32.924164 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:32.924127    2583 generic.go:356] "Generic (PLEG): container finished" podID="569bee75-010b-48aa-a2ca-bea8f1753911" containerID="3cb8541ec614d2a382524935666be51ce1c54bd0e3aa50f54f15ebe398195718" exitCode=0
Jul 22 21:38:32.924698 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:32.924181    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7" event={"ID":"569bee75-010b-48aa-a2ca-bea8f1753911","Type":"ContainerDied","Data":"3cb8541ec614d2a382524935666be51ce1c54bd0e3aa50f54f15ebe398195718"}
Jul 22 21:38:32.924698 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:32.924639    2583 scope.go:117] "RemoveContainer" containerID="3cb8541ec614d2a382524935666be51ce1c54bd0e3aa50f54f15ebe398195718"
Jul 22 21:38:32.925722 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:32.925683    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:38:32.925832 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:32.925761    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:38:32.925832 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:32.925791    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:38:33.930368 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:33.930288    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7" event={"ID":"569bee75-010b-48aa-a2ca-bea8f1753911","Type":"ContainerStarted","Data":"a145457ca8ca9b8129b778e9f369b8b06d81a2f11d2ccf5d62238dd0e72659bb"}
Jul 22 21:38:34.350038 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:34.350009    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:34.350266 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:34.350242    2583 patch_prober.go:28] interesting pod/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 22 21:38:34.350322 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:34.350302    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7" podUID="569bee75-010b-48aa-a2ca-bea8f1753911" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 22 21:38:35.350097 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:35.350051    2583 patch_prober.go:28] interesting pod/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 22 21:38:35.350501 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:35.350140    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7" podUID="569bee75-010b-48aa-a2ca-bea8f1753911" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 22 21:38:36.350425 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:36.350387    2583 patch_prober.go:28] interesting pod/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 22 21:38:36.350828 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:36.350443    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7" podUID="569bee75-010b-48aa-a2ca-bea8f1753911" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 22 21:38:37.325736 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:37.325700    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5d7596-fdjww"]
Jul 22 21:38:37.329612 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:37.329591    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5d7596-fdjww"
Jul 22 21:38:37.331780 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:37.331758    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zz5vc\""
Jul 22 21:38:37.335865 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:37.335847    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5d7596-fdjww"]
Jul 22 21:38:37.350474 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:37.350448    2583 patch_prober.go:28] interesting pod/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 22 21:38:37.350746 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:37.350506    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7" podUID="569bee75-010b-48aa-a2ca-bea8f1753911" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 22 21:38:37.505605 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:37.505574    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08052557-3fc0-4176-a17e-29fb346e7a16-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-5d7596-fdjww\" (UID: \"08052557-3fc0-4176-a17e-29fb346e7a16\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5d7596-fdjww"
Jul 22 21:38:37.606532 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:37.606491    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08052557-3fc0-4176-a17e-29fb346e7a16-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-5d7596-fdjww\" (UID: \"08052557-3fc0-4176-a17e-29fb346e7a16\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5d7596-fdjww"
Jul 22 21:38:37.607101 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:37.607080    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08052557-3fc0-4176-a17e-29fb346e7a16-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-5d7596-fdjww\" (UID: \"08052557-3fc0-4176-a17e-29fb346e7a16\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5d7596-fdjww"
Jul 22 21:38:37.641903 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:37.641865    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5d7596-fdjww"
Jul 22 21:38:37.799965 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:37.799819    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5d7596-fdjww"]
Jul 22 21:38:37.803269 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:38:37.803233    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08052557_3fc0_4176_a17e_29fb346e7a16.slice/crio-f46d853e1e6fa5565c995ba57b75c650358c021c54424ba9eff04fac8050b226 WatchSource:0}: Error finding container f46d853e1e6fa5565c995ba57b75c650358c021c54424ba9eff04fac8050b226: Status 404 returned error can't find the container with id f46d853e1e6fa5565c995ba57b75c650358c021c54424ba9eff04fac8050b226
Jul 22 21:38:37.951054 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:37.950965    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5d7596-fdjww" event={"ID":"08052557-3fc0-4176-a17e-29fb346e7a16","Type":"ContainerStarted","Data":"f46d853e1e6fa5565c995ba57b75c650358c021c54424ba9eff04fac8050b226"}
Jul 22 21:38:38.354745 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:38.354707    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:38.355227 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:38.355143    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:38.355934 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:38.355911    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:38:38.958661 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:38.958624    2583 generic.go:356] "Generic (PLEG): container finished" podID="08052557-3fc0-4176-a17e-29fb346e7a16" containerID="a988cbe50e64bfbb7e5c156244569ce8835d0dadc8520dd3f55cb44601864686" exitCode=0
Jul 22 21:38:38.958823 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:38.958706    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5d7596-fdjww" event={"ID":"08052557-3fc0-4176-a17e-29fb346e7a16","Type":"ContainerDied","Data":"a988cbe50e64bfbb7e5c156244569ce8835d0dadc8520dd3f55cb44601864686"}
Jul 22 21:38:39.919264 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:39.919221    2583 patch_prober.go:28] interesting pod/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 22 21:38:39.919650 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:39.919293    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw" podUID="4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 22 21:38:40.108054 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:40.108029    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5d7596-fdjww"
Jul 22 21:38:40.230773 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:40.230747    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08052557-3fc0-4176-a17e-29fb346e7a16-maas-api-service-ca\") pod \"08052557-3fc0-4176-a17e-29fb346e7a16\" (UID: \"08052557-3fc0-4176-a17e-29fb346e7a16\") "
Jul 22 21:38:40.234094 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:40.231051    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08052557-3fc0-4176-a17e-29fb346e7a16-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "08052557-3fc0-4176-a17e-29fb346e7a16" (UID: "08052557-3fc0-4176-a17e-29fb346e7a16"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:38:40.234094 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:40.231164    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08052557-3fc0-4176-a17e-29fb346e7a16-maas-api-service-ca\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:38:40.972932 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:40.972891    2583 generic.go:356] "Generic (PLEG): container finished" podID="4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" containerID="0af307a12e791d1f1586dea59399907873fd418ecb431216b2cf472af201a7f2" exitCode=0
Jul 22 21:38:40.973423 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:40.972969    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw" event={"ID":"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9","Type":"ContainerDied","Data":"0af307a12e791d1f1586dea59399907873fd418ecb431216b2cf472af201a7f2"}
Jul 22 21:38:40.973509 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:40.973446    2583 scope.go:117] "RemoveContainer" containerID="0af307a12e791d1f1586dea59399907873fd418ecb431216b2cf472af201a7f2"
Jul 22 21:38:40.974708 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:40.974681    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5d7596-fdjww" event={"ID":"08052557-3fc0-4176-a17e-29fb346e7a16","Type":"ContainerDied","Data":"f46d853e1e6fa5565c995ba57b75c650358c021c54424ba9eff04fac8050b226"}
Jul 22 21:38:40.974827 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:40.974721    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f46d853e1e6fa5565c995ba57b75c650358c021c54424ba9eff04fac8050b226"
Jul 22 21:38:40.974827 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:40.974736    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5d7596-fdjww"
Jul 22 21:38:40.974916 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:40.974727    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:38:40.974960 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:40.974919    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:38:40.974996 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:40.974978    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:38:41.981749 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:41.981714    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw" event={"ID":"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9","Type":"ContainerStarted","Data":"2db23c03b251b3e1fcb161ca12db3b954019a63e92699d057dc10673e4e2ed63"}
Jul 22 21:38:42.369704 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:42.369643    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:42.369931 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:42.369840    2583 patch_prober.go:28] interesting pod/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 22 21:38:42.369931 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:42.369886    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw" podUID="4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 22 21:38:42.619079 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:42.619033    2583 scope.go:117] "RemoveContainer" containerID="956b9454ccab43a6cff0a3339fc69120fcf260ff9552c5e6c61d796badeb9d8d"
Jul 22 21:38:43.369559 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:43.369523    2583 patch_prober.go:28] interesting pod/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 22 21:38:43.370505 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:43.370096    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw" podUID="4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 22 21:38:44.370279 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:44.370241    2583 patch_prober.go:28] interesting pod/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 22 21:38:44.370772 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:44.370301    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw" podUID="4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 22 21:38:45.369382 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:45.369341    2583 patch_prober.go:28] interesting pod/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 22 21:38:45.369566 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:45.369421    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw" podUID="4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 22 21:38:46.373442 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:46.373408    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:46.373847 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:46.373748    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:46.374415 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:46.374394    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:38:57.405365 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:57.405331    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5d7596-fdjww"]
Jul 22 21:38:57.409369 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:57.409344    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5d7596-fdjww"]
Jul 22 21:38:58.408593 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:38:58.408562    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08052557-3fc0-4176-a17e-29fb346e7a16" path="/var/lib/kubelet/pods/08052557-3fc0-4176-a17e-29fb346e7a16/volumes"
Jul 22 21:39:03.880195 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:03.880165    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"]
Jul 22 21:39:03.880654 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:03.880367    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7" podUID="569bee75-010b-48aa-a2ca-bea8f1753911" containerName="istio-proxy" containerID="cri-o://a145457ca8ca9b8129b778e9f369b8b06d81a2f11d2ccf5d62238dd0e72659bb" gracePeriod=30
Jul 22 21:39:04.238650 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:04.238578    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-af2d1d-2cq4h"]
Jul 22 21:39:04.238893 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:04.238881    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08052557-3fc0-4176-a17e-29fb346e7a16" containerName="revoke-keys"
Jul 22 21:39:04.238934 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:04.238895    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="08052557-3fc0-4176-a17e-29fb346e7a16" containerName="revoke-keys"
Jul 22 21:39:04.238976 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:04.238968    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="08052557-3fc0-4176-a17e-29fb346e7a16" containerName="revoke-keys"
Jul 22 21:39:04.241885 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:04.241870    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-af2d1d-2cq4h"
Jul 22 21:39:04.244261 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:04.244240    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zz5vc\""
Jul 22 21:39:04.252766 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:04.252741    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-af2d1d-2cq4h"]
Jul 22 21:39:04.344748 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:04.344720    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78989e1e-037d-40e8-9295-a87e2f51908a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-af2d1d-2cq4h\" (UID: \"78989e1e-037d-40e8-9295-a87e2f51908a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-af2d1d-2cq4h"
Jul 22 21:39:04.445583 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:04.445557    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78989e1e-037d-40e8-9295-a87e2f51908a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-af2d1d-2cq4h\" (UID: \"78989e1e-037d-40e8-9295-a87e2f51908a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-af2d1d-2cq4h"
Jul 22 21:39:04.446183 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:04.446164    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78989e1e-037d-40e8-9295-a87e2f51908a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-af2d1d-2cq4h\" (UID: \"78989e1e-037d-40e8-9295-a87e2f51908a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-af2d1d-2cq4h"
Jul 22 21:39:04.552152 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:04.552094    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-af2d1d-2cq4h"
Jul 22 21:39:04.684895 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:04.684868    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-af2d1d-2cq4h"]
Jul 22 21:39:04.686722 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:39:04.686696    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78989e1e_037d_40e8_9295_a87e2f51908a.slice/crio-070e15cadd69fbd7cc4906a1cbcb371e28125eebfd5fbcbc1d4d2c8b89ab45b5 WatchSource:0}: Error finding container 070e15cadd69fbd7cc4906a1cbcb371e28125eebfd5fbcbc1d4d2c8b89ab45b5: Status 404 returned error can't find the container with id 070e15cadd69fbd7cc4906a1cbcb371e28125eebfd5fbcbc1d4d2c8b89ab45b5
Jul 22 21:39:05.090326 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:05.090303    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-af2d1d-2cq4h" event={"ID":"78989e1e-037d-40e8-9295-a87e2f51908a","Type":"ContainerStarted","Data":"2e69b5dd0bfadffc2c2d84d94da39143cd3efa693e3ef7a048ae4b59e6fb5ed7"}
Jul 22 21:39:05.090662 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:05.090346    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-af2d1d-2cq4h" event={"ID":"78989e1e-037d-40e8-9295-a87e2f51908a","Type":"ContainerStarted","Data":"070e15cadd69fbd7cc4906a1cbcb371e28125eebfd5fbcbc1d4d2c8b89ab45b5"}
Jul 22 21:39:05.108216 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:05.108158    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-af2d1d-2cq4h" podStartSLOduration=1.10814 podStartE2EDuration="1.10814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:39:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:39:05.105619805 +0000 UTC m=+2543.129658385" watchObservedRunningTime="2026-07-22 21:39:05.10814 +0000 UTC m=+2543.132178580"
Jul 22 21:39:06.096942 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:06.096908    2583 generic.go:356] "Generic (PLEG): container finished" podID="78989e1e-037d-40e8-9295-a87e2f51908a" containerID="2e69b5dd0bfadffc2c2d84d94da39143cd3efa693e3ef7a048ae4b59e6fb5ed7" exitCode=0
Jul 22 21:39:06.097319 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:06.096998    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-af2d1d-2cq4h" event={"ID":"78989e1e-037d-40e8-9295-a87e2f51908a","Type":"ContainerDied","Data":"2e69b5dd0bfadffc2c2d84d94da39143cd3efa693e3ef7a048ae4b59e6fb5ed7"}
Jul 22 21:39:07.222502 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:07.222478    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-af2d1d-2cq4h"
Jul 22 21:39:07.369793 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:07.369729    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78989e1e-037d-40e8-9295-a87e2f51908a-maas-api-service-ca\") pod \"78989e1e-037d-40e8-9295-a87e2f51908a\" (UID: \"78989e1e-037d-40e8-9295-a87e2f51908a\") "
Jul 22 21:39:07.370032 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:07.370010    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78989e1e-037d-40e8-9295-a87e2f51908a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "78989e1e-037d-40e8-9295-a87e2f51908a" (UID: "78989e1e-037d-40e8-9295-a87e2f51908a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:39:07.470980 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:07.470953    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78989e1e-037d-40e8-9295-a87e2f51908a-maas-api-service-ca\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:39:08.106925 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:08.106897    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-af2d1d-2cq4h"
Jul 22 21:39:08.107084 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:08.106933    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-af2d1d-2cq4h" event={"ID":"78989e1e-037d-40e8-9295-a87e2f51908a","Type":"ContainerDied","Data":"070e15cadd69fbd7cc4906a1cbcb371e28125eebfd5fbcbc1d4d2c8b89ab45b5"}
Jul 22 21:39:08.107084 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:08.106980    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="070e15cadd69fbd7cc4906a1cbcb371e28125eebfd5fbcbc1d4d2c8b89ab45b5"
Jul 22 21:39:08.357072 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:08.356995    2583 patch_prober.go:28] interesting pod/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 21:39:08.357429 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:08.357084    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7" podUID="569bee75-010b-48aa-a2ca-bea8f1753911" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 21:39:09.112994 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.112966    2583 generic.go:356] "Generic (PLEG): container finished" podID="569bee75-010b-48aa-a2ca-bea8f1753911" containerID="a145457ca8ca9b8129b778e9f369b8b06d81a2f11d2ccf5d62238dd0e72659bb" exitCode=0
Jul 22 21:39:09.113179 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.113014    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7" event={"ID":"569bee75-010b-48aa-a2ca-bea8f1753911","Type":"ContainerDied","Data":"a145457ca8ca9b8129b778e9f369b8b06d81a2f11d2ccf5d62238dd0e72659bb"}
Jul 22 21:39:09.113248 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.113231    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7" event={"ID":"569bee75-010b-48aa-a2ca-bea8f1753911","Type":"ContainerDied","Data":"ea2f2d5328b528609db93c7c5929d3fa8083dd6a9343b72917ac515432f2075f"}
Jul 22 21:39:09.113291 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.113259    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea2f2d5328b528609db93c7c5929d3fa8083dd6a9343b72917ac515432f2075f"
Jul 22 21:39:09.113291 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.113274    2583 scope.go:117] "RemoveContainer" containerID="3cb8541ec614d2a382524935666be51ce1c54bd0e3aa50f54f15ebe398195718"
Jul 22 21:39:09.125362 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:39:09.125342    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cb8541ec614d2a382524935666be51ce1c54bd0e3aa50f54f15ebe398195718\": container with ID starting with 3cb8541ec614d2a382524935666be51ce1c54bd0e3aa50f54f15ebe398195718 not found: ID does not exist" containerID="3cb8541ec614d2a382524935666be51ce1c54bd0e3aa50f54f15ebe398195718"
Jul 22 21:39:09.128920 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.128903    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:39:09.282559 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.282503    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-workload-certs\") pod \"569bee75-010b-48aa-a2ca-bea8f1753911\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") "
Jul 22 21:39:09.282559 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.282543    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/569bee75-010b-48aa-a2ca-bea8f1753911-istiod-ca-cert\") pod \"569bee75-010b-48aa-a2ca-bea8f1753911\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") "
Jul 22 21:39:09.282725 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.282571    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/569bee75-010b-48aa-a2ca-bea8f1753911-istio-token\") pod \"569bee75-010b-48aa-a2ca-bea8f1753911\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") "
Jul 22 21:39:09.282725 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.282609    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-credential-socket\") pod \"569bee75-010b-48aa-a2ca-bea8f1753911\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") "
Jul 22 21:39:09.282725 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.282635    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/569bee75-010b-48aa-a2ca-bea8f1753911-istio-podinfo\") pod \"569bee75-010b-48aa-a2ca-bea8f1753911\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") "
Jul 22 21:39:09.282725 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.282664    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-istio-data\") pod \"569bee75-010b-48aa-a2ca-bea8f1753911\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") "
Jul 22 21:39:09.282725 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.282720    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-workload-socket\") pod \"569bee75-010b-48aa-a2ca-bea8f1753911\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") "
Jul 22 21:39:09.282977 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.282742    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-istio-envoy\") pod \"569bee75-010b-48aa-a2ca-bea8f1753911\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") "
Jul 22 21:39:09.282977 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.282770    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92mqc\" (UniqueName: \"kubernetes.io/projected/569bee75-010b-48aa-a2ca-bea8f1753911-kube-api-access-92mqc\") pod \"569bee75-010b-48aa-a2ca-bea8f1753911\" (UID: \"569bee75-010b-48aa-a2ca-bea8f1753911\") "
Jul 22 21:39:09.283085 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.282765    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "569bee75-010b-48aa-a2ca-bea8f1753911" (UID: "569bee75-010b-48aa-a2ca-bea8f1753911"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:39:09.283085 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.282932    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "569bee75-010b-48aa-a2ca-bea8f1753911" (UID: "569bee75-010b-48aa-a2ca-bea8f1753911"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:39:09.283085 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.282979    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/569bee75-010b-48aa-a2ca-bea8f1753911-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "569bee75-010b-48aa-a2ca-bea8f1753911" (UID: "569bee75-010b-48aa-a2ca-bea8f1753911"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:39:09.283085 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.283002    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "569bee75-010b-48aa-a2ca-bea8f1753911" (UID: "569bee75-010b-48aa-a2ca-bea8f1753911"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:39:09.283714 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.283691    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-istio-data" (OuterVolumeSpecName: "istio-data") pod "569bee75-010b-48aa-a2ca-bea8f1753911" (UID: "569bee75-010b-48aa-a2ca-bea8f1753911"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:39:09.284869 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.284837    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/569bee75-010b-48aa-a2ca-bea8f1753911-istio-token" (OuterVolumeSpecName: "istio-token") pod "569bee75-010b-48aa-a2ca-bea8f1753911" (UID: "569bee75-010b-48aa-a2ca-bea8f1753911"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:39:09.285164 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.285139    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/569bee75-010b-48aa-a2ca-bea8f1753911-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "569bee75-010b-48aa-a2ca-bea8f1753911" (UID: "569bee75-010b-48aa-a2ca-bea8f1753911"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 21:39:09.285458 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.285435    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/569bee75-010b-48aa-a2ca-bea8f1753911-kube-api-access-92mqc" (OuterVolumeSpecName: "kube-api-access-92mqc") pod "569bee75-010b-48aa-a2ca-bea8f1753911" (UID: "569bee75-010b-48aa-a2ca-bea8f1753911"). InnerVolumeSpecName "kube-api-access-92mqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:39:09.285530 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.285434    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "569bee75-010b-48aa-a2ca-bea8f1753911" (UID: "569bee75-010b-48aa-a2ca-bea8f1753911"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:39:09.383676 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.383651    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-istio-data\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:39:09.383676 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.383672    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-workload-socket\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:39:09.383981 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.383681    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-istio-envoy\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:39:09.383981 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.383688    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92mqc\" (UniqueName: \"kubernetes.io/projected/569bee75-010b-48aa-a2ca-bea8f1753911-kube-api-access-92mqc\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:39:09.383981 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.383698    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-workload-certs\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:39:09.383981 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.383706    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/569bee75-010b-48aa-a2ca-bea8f1753911-istiod-ca-cert\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:39:09.383981 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.383712    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/569bee75-010b-48aa-a2ca-bea8f1753911-istio-token\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:39:09.383981 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.383719    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/569bee75-010b-48aa-a2ca-bea8f1753911-credential-socket\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:39:09.383981 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:09.383727    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/569bee75-010b-48aa-a2ca-bea8f1753911-istio-podinfo\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:39:10.122805 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:10.122777    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"
Jul 22 21:39:10.143550 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:10.143522    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"]
Jul 22 21:39:10.153169 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:10.148711    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-5d7596-openshift-default-74b655c7c5-sc5g7"]
Jul 22 21:39:10.409977 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:10.409915    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="569bee75-010b-48aa-a2ca-bea8f1753911" path="/var/lib/kubelet/pods/569bee75-010b-48aa-a2ca-bea8f1753911/volumes"
Jul 22 21:39:24.324314 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:24.324275    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-af2d1d-2cq4h"]
Jul 22 21:39:24.326581 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:24.326558    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-af2d1d-2cq4h"]
Jul 22 21:39:24.409350 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:24.409324    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78989e1e-037d-40e8-9295-a87e2f51908a" path="/var/lib/kubelet/pods/78989e1e-037d-40e8-9295-a87e2f51908a/volumes"
Jul 22 21:39:30.670278 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:30.670235    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"]
Jul 22 21:39:30.670711 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:30.670464    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw" podUID="4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" containerName="istio-proxy" containerID="cri-o://2db23c03b251b3e1fcb161ca12db3b954019a63e92699d057dc10673e4e2ed63" gracePeriod=30
Jul 22 21:39:31.376528 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.376487    2583 patch_prober.go:28] interesting pod/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 21:39:31.376716 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.376551    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw" podUID="4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 21:39:31.521665 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.521625    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"]
Jul 22 21:39:31.522036 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.522013    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="569bee75-010b-48aa-a2ca-bea8f1753911" containerName="istio-proxy"
Jul 22 21:39:31.522036 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.522036    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="569bee75-010b-48aa-a2ca-bea8f1753911" containerName="istio-proxy"
Jul 22 21:39:31.522212 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.522054    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="569bee75-010b-48aa-a2ca-bea8f1753911" containerName="istio-proxy"
Jul 22 21:39:31.522212 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.522060    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="569bee75-010b-48aa-a2ca-bea8f1753911" containerName="istio-proxy"
Jul 22 21:39:31.522212 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.522074    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78989e1e-037d-40e8-9295-a87e2f51908a" containerName="revoke-keys"
Jul 22 21:39:31.522212 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.522079    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="78989e1e-037d-40e8-9295-a87e2f51908a" containerName="revoke-keys"
Jul 22 21:39:31.522212 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.522149    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="569bee75-010b-48aa-a2ca-bea8f1753911" containerName="istio-proxy"
Jul 22 21:39:31.522212 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.522161    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="78989e1e-037d-40e8-9295-a87e2f51908a" containerName="revoke-keys"
Jul 22 21:39:31.525320 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.525302    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.527529 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.527508    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-644efc-openshift-default-dockercfg-dhngt\""
Jul 22 21:39:31.535887 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.535863    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"]
Jul 22 21:39:31.563362 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.563323    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-workload-certs\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.563531 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.563382    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-workload-socket\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.563531 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.563477    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-istio-envoy\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.563531 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.563516    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/228995b1-68ac-4b15-81ec-7627fcacfc89-istiod-ca-cert\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.563655 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.563558    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/228995b1-68ac-4b15-81ec-7627fcacfc89-istio-podinfo\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.563655 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.563599    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-istio-data\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.563655 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.563622    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69688\" (UniqueName: \"kubernetes.io/projected/228995b1-68ac-4b15-81ec-7627fcacfc89-kube-api-access-69688\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.563655 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.563646    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-credential-socket\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.563794 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.563661    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/228995b1-68ac-4b15-81ec-7627fcacfc89-istio-token\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.665103 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.665030    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-istio-envoy\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.665103 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.665061    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/228995b1-68ac-4b15-81ec-7627fcacfc89-istiod-ca-cert\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.665103 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.665078    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/228995b1-68ac-4b15-81ec-7627fcacfc89-istio-podinfo\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.665103 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.665102    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-istio-data\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.665422 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.665141    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69688\" (UniqueName: \"kubernetes.io/projected/228995b1-68ac-4b15-81ec-7627fcacfc89-kube-api-access-69688\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.665422 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.665174    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-credential-socket\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.665422 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.665199    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/228995b1-68ac-4b15-81ec-7627fcacfc89-istio-token\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.665422 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.665224    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-workload-certs\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.665422 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.665396    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-workload-socket\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.665677 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.665550    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-credential-socket\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.665677 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.665623    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-workload-certs\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.665677 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.665651    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-istio-data\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.666008 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.665795    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-workload-socket\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.666008 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.665856    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/228995b1-68ac-4b15-81ec-7627fcacfc89-istiod-ca-cert\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.667424 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.667399    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-istio-envoy\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.667737 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.667721    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/228995b1-68ac-4b15-81ec-7627fcacfc89-istio-podinfo\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.672696 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.672675    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69688\" (UniqueName: \"kubernetes.io/projected/228995b1-68ac-4b15-81ec-7627fcacfc89-kube-api-access-69688\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.672960 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.672813    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/228995b1-68ac-4b15-81ec-7627fcacfc89-istio-token\") pod \"e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") " pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.836312 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.836280    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:31.972265 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.972241    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"]
Jul 22 21:39:31.974374 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:39:31.974344    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod228995b1_68ac_4b15_81ec_7627fcacfc89.slice/crio-adc163bdfe088526e1d05c92a3f7c6353392cec8b8f145c1dd31a3979d52212a WatchSource:0}: Error finding container adc163bdfe088526e1d05c92a3f7c6353392cec8b8f145c1dd31a3979d52212a: Status 404 returned error can't find the container with id adc163bdfe088526e1d05c92a3f7c6353392cec8b8f145c1dd31a3979d52212a
Jul 22 21:39:31.976563 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.976531    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:39:31.976652 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.976598    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:39:31.976652 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:31.976628    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:39:32.223222 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:32.223143    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv" event={"ID":"228995b1-68ac-4b15-81ec-7627fcacfc89","Type":"ContainerStarted","Data":"43251f9eb5aae14ffa1625051c596dee9af047a5fdf7c18529f7181d7a2902b4"}
Jul 22 21:39:32.223222 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:32.223198    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv" event={"ID":"228995b1-68ac-4b15-81ec-7627fcacfc89","Type":"ContainerStarted","Data":"adc163bdfe088526e1d05c92a3f7c6353392cec8b8f145c1dd31a3979d52212a"}
Jul 22 21:39:32.245563 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:32.245521    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv" podStartSLOduration=1.245506648 podStartE2EDuration="1.245506648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:39:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:39:32.244214955 +0000 UTC m=+2570.268253525" watchObservedRunningTime="2026-07-22 21:39:32.245506648 +0000 UTC m=+2570.269545226"
Jul 22 21:39:32.837094 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:32.837064    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:33.841991 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:33.841964    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:34.232122 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:34.232076    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:34.232899 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:34.232880    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:35.918659 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:35.918632    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:39:36.004669 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.004596    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istio-data\") pod \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") "
Jul 22 21:39:36.004669 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.004636    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wv9k\" (UniqueName: \"kubernetes.io/projected/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-kube-api-access-2wv9k\") pod \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") "
Jul 22 21:39:36.004863 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.004685    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-workload-socket\") pod \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") "
Jul 22 21:39:36.004863 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.004724    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istio-token\") pod \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") "
Jul 22 21:39:36.004863 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.004759    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-credential-socket\") pod \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") "
Jul 22 21:39:36.004863 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.004782    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istio-envoy\") pod \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") "
Jul 22 21:39:36.004863 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.004805    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-workload-certs\") pod \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") "
Jul 22 21:39:36.004863 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.004837    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istiod-ca-cert\") pod \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") "
Jul 22 21:39:36.005180 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.004867    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istio-podinfo\") pod \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\" (UID: \"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9\") "
Jul 22 21:39:36.005180 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.005079    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" (UID: "4c7632e1-e113-4cfc-b472-f0daeaa9e1f9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:39:36.005180 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.005091    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" (UID: "4c7632e1-e113-4cfc-b472-f0daeaa9e1f9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:39:36.005343 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.005236    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-workload-socket\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:39:36.005343 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.005249    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-credential-socket\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:39:36.005433 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.005353    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" (UID: "4c7632e1-e113-4cfc-b472-f0daeaa9e1f9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:39:36.005433 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.005202    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" (UID: "4c7632e1-e113-4cfc-b472-f0daeaa9e1f9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:39:36.005433 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.005420    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istio-data" (OuterVolumeSpecName: "istio-data") pod "4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" (UID: "4c7632e1-e113-4cfc-b472-f0daeaa9e1f9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:39:36.006985 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.006957    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" (UID: "4c7632e1-e113-4cfc-b472-f0daeaa9e1f9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:39:36.007266 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.007240    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" (UID: "4c7632e1-e113-4cfc-b472-f0daeaa9e1f9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 21:39:36.007369 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.007277    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istio-token" (OuterVolumeSpecName: "istio-token") pod "4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" (UID: "4c7632e1-e113-4cfc-b472-f0daeaa9e1f9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:39:36.007369 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.007315    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-kube-api-access-2wv9k" (OuterVolumeSpecName: "kube-api-access-2wv9k") pod "4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" (UID: "4c7632e1-e113-4cfc-b472-f0daeaa9e1f9"). InnerVolumeSpecName "kube-api-access-2wv9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:39:36.106195 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.106175    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istio-data\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:39:36.106195 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.106197    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wv9k\" (UniqueName: \"kubernetes.io/projected/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-kube-api-access-2wv9k\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:39:36.106195 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.106207    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istio-token\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:39:36.106389 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.106217    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istio-envoy\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:39:36.106389 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.106225    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-workload-certs\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:39:36.106389 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.106232    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istiod-ca-cert\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:39:36.106389 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.106239    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9-istio-podinfo\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:39:36.242427 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.242400    2583 generic.go:356] "Generic (PLEG): container finished" podID="4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" containerID="2db23c03b251b3e1fcb161ca12db3b954019a63e92699d057dc10673e4e2ed63" exitCode=0
Jul 22 21:39:36.242544 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.242440    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw" event={"ID":"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9","Type":"ContainerDied","Data":"2db23c03b251b3e1fcb161ca12db3b954019a63e92699d057dc10673e4e2ed63"}
Jul 22 21:39:36.242544 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.242490    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw" event={"ID":"4c7632e1-e113-4cfc-b472-f0daeaa9e1f9","Type":"ContainerDied","Data":"66ff5c8c33e2a92af5184a3734b1b39ec12687809b0409a0f9394125e9f286f9"}
Jul 22 21:39:36.242544 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.242511    2583 scope.go:117] "RemoveContainer" containerID="2db23c03b251b3e1fcb161ca12db3b954019a63e92699d057dc10673e4e2ed63"
Jul 22 21:39:36.242544 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.242451    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"
Jul 22 21:39:36.252192 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.252175    2583 scope.go:117] "RemoveContainer" containerID="0af307a12e791d1f1586dea59399907873fd418ecb431216b2cf472af201a7f2"
Jul 22 21:39:36.259745 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.259725    2583 scope.go:117] "RemoveContainer" containerID="2db23c03b251b3e1fcb161ca12db3b954019a63e92699d057dc10673e4e2ed63"
Jul 22 21:39:36.259994 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:39:36.259975    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2db23c03b251b3e1fcb161ca12db3b954019a63e92699d057dc10673e4e2ed63\": container with ID starting with 2db23c03b251b3e1fcb161ca12db3b954019a63e92699d057dc10673e4e2ed63 not found: ID does not exist" containerID="2db23c03b251b3e1fcb161ca12db3b954019a63e92699d057dc10673e4e2ed63"
Jul 22 21:39:36.260041 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.260002    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2db23c03b251b3e1fcb161ca12db3b954019a63e92699d057dc10673e4e2ed63"} err="failed to get container status \"2db23c03b251b3e1fcb161ca12db3b954019a63e92699d057dc10673e4e2ed63\": rpc error: code = NotFound desc = could not find container \"2db23c03b251b3e1fcb161ca12db3b954019a63e92699d057dc10673e4e2ed63\": container with ID starting with 2db23c03b251b3e1fcb161ca12db3b954019a63e92699d057dc10673e4e2ed63 not found: ID does not exist"
Jul 22 21:39:36.260041 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.260019    2583 scope.go:117] "RemoveContainer" containerID="0af307a12e791d1f1586dea59399907873fd418ecb431216b2cf472af201a7f2"
Jul 22 21:39:36.260272 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:39:36.260253    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0af307a12e791d1f1586dea59399907873fd418ecb431216b2cf472af201a7f2\": container with ID starting with 0af307a12e791d1f1586dea59399907873fd418ecb431216b2cf472af201a7f2 not found: ID does not exist" containerID="0af307a12e791d1f1586dea59399907873fd418ecb431216b2cf472af201a7f2"
Jul 22 21:39:36.260321 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.260276    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0af307a12e791d1f1586dea59399907873fd418ecb431216b2cf472af201a7f2"} err="failed to get container status \"0af307a12e791d1f1586dea59399907873fd418ecb431216b2cf472af201a7f2\": rpc error: code = NotFound desc = could not find container \"0af307a12e791d1f1586dea59399907873fd418ecb431216b2cf472af201a7f2\": container with ID starting with 0af307a12e791d1f1586dea59399907873fd418ecb431216b2cf472af201a7f2 not found: ID does not exist"
Jul 22 21:39:36.263166 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.263145    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"]
Jul 22 21:39:36.267000 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.266979    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-af2d1d-openshift-default-5d476b4685-pnvmw"]
Jul 22 21:39:36.409157 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:36.409133    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" path="/var/lib/kubelet/pods/4c7632e1-e113-4cfc-b472-f0daeaa9e1f9/volumes"
Jul 22 21:39:39.235834 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.235797    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"]
Jul 22 21:39:39.236226 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.236197    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" containerName="istio-proxy"
Jul 22 21:39:39.236226 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.236209    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" containerName="istio-proxy"
Jul 22 21:39:39.236226 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.236219    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" containerName="istio-proxy"
Jul 22 21:39:39.236226 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.236224    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" containerName="istio-proxy"
Jul 22 21:39:39.236351 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.236274    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" containerName="istio-proxy"
Jul 22 21:39:39.236351 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.236282    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="569bee75-010b-48aa-a2ca-bea8f1753911" containerName="istio-proxy"
Jul 22 21:39:39.240479 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.240458    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.243404 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.243388    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-bfd0ef-openshift-default-dockercfg-p7rll\""
Jul 22 21:39:39.257245 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.257222    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"]
Jul 22 21:39:39.335095 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.335064    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-istio-data\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.335095 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.335094    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2e33d87-8468-4129-8742-b91608ebdae8-istiod-ca-cert\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.335345 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.335129    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2e33d87-8468-4129-8742-b91608ebdae8-istio-podinfo\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.335345 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.335260    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-credential-socket\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.335345 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.335316    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2e33d87-8468-4129-8742-b91608ebdae8-istio-token\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.335487 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.335384    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwt7b\" (UniqueName: \"kubernetes.io/projected/b2e33d87-8468-4129-8742-b91608ebdae8-kube-api-access-wwt7b\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.335487 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.335460    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-workload-certs\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.335594 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.335491    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-istio-envoy\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.335594 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.335527    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-workload-socket\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.436442 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.436410    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-istio-data\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.436442 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.436444    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2e33d87-8468-4129-8742-b91608ebdae8-istiod-ca-cert\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.436731 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.436462    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2e33d87-8468-4129-8742-b91608ebdae8-istio-podinfo\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.436731 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.436540    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-credential-socket\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.436731 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.436595    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2e33d87-8468-4129-8742-b91608ebdae8-istio-token\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.436731 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.436619    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwt7b\" (UniqueName: \"kubernetes.io/projected/b2e33d87-8468-4129-8742-b91608ebdae8-kube-api-access-wwt7b\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.436963 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.436812    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-workload-certs\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.436963 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.436856    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-istio-envoy\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.436963 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.436861    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-istio-data\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.436963 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.436911    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-workload-socket\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.437202 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.436974    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-credential-socket\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.437262 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.437242    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-workload-socket\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.437312 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.437284    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-workload-certs\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.437620 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.437554    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2e33d87-8468-4129-8742-b91608ebdae8-istiod-ca-cert\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.439096 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.439073    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-istio-envoy\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.439216 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.439103    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2e33d87-8468-4129-8742-b91608ebdae8-istio-podinfo\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.444439 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.444416    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwt7b\" (UniqueName: \"kubernetes.io/projected/b2e33d87-8468-4129-8742-b91608ebdae8-kube-api-access-wwt7b\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.444522 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.444462    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2e33d87-8468-4129-8742-b91608ebdae8-istio-token\") pod \"e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") " pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.550303 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.550218    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:39.726178 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.726152    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"]
Jul 22 21:39:39.729126 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:39:39.729082    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e33d87_8468_4129_8742_b91608ebdae8.slice/crio-ed70dcf00c453015531e560425164641713e119752493aca77e7eb6cacc6d7f1 WatchSource:0}: Error finding container ed70dcf00c453015531e560425164641713e119752493aca77e7eb6cacc6d7f1: Status 404 returned error can't find the container with id ed70dcf00c453015531e560425164641713e119752493aca77e7eb6cacc6d7f1
Jul 22 21:39:39.731744 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.731711    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:39:39.731846 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.731771    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:39:39.731846 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:39.731797    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:39:40.266326 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:40.266284    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs" event={"ID":"b2e33d87-8468-4129-8742-b91608ebdae8","Type":"ContainerStarted","Data":"3af85b2d159e1334357aeb1e9a798d314b0cf19a9789b5a2e7f78cbc8e8a6756"}
Jul 22 21:39:40.266813 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:40.266391    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs" event={"ID":"b2e33d87-8468-4129-8742-b91608ebdae8","Type":"ContainerStarted","Data":"ed70dcf00c453015531e560425164641713e119752493aca77e7eb6cacc6d7f1"}
Jul 22 21:39:40.287536 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:40.287482    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs" podStartSLOduration=1.287465355 podStartE2EDuration="1.287465355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:39:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:39:40.285388594 +0000 UTC m=+2578.309427172" watchObservedRunningTime="2026-07-22 21:39:40.287465355 +0000 UTC m=+2578.311503934"
Jul 22 21:39:40.551390 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:40.551301    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:40.563670 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:40.563629    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:41.273664 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:41.273638    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:41.279473 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:41.279445    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:46.304291 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:46.304260    2583 generic.go:356] "Generic (PLEG): container finished" podID="228995b1-68ac-4b15-81ec-7627fcacfc89" containerID="43251f9eb5aae14ffa1625051c596dee9af047a5fdf7c18529f7181d7a2902b4" exitCode=0
Jul 22 21:39:46.304661 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:46.304332    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv" event={"ID":"228995b1-68ac-4b15-81ec-7627fcacfc89","Type":"ContainerDied","Data":"43251f9eb5aae14ffa1625051c596dee9af047a5fdf7c18529f7181d7a2902b4"}
Jul 22 21:39:46.304712 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:46.304663    2583 scope.go:117] "RemoveContainer" containerID="43251f9eb5aae14ffa1625051c596dee9af047a5fdf7c18529f7181d7a2902b4"
Jul 22 21:39:46.305635 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:46.305607    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:39:46.305717 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:46.305678    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:39:46.305755 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:46.305721    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:39:47.311693 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:47.311658    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv" event={"ID":"228995b1-68ac-4b15-81ec-7627fcacfc89","Type":"ContainerStarted","Data":"aabb65c7166fc05169313b49107efbe56b3ce49a24914d1f5346c6f1dff6b238"}
Jul 22 21:39:47.836941 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:47.836902    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:47.837861 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:47.837832    2583 patch_prober.go:28] interesting pod/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 22 21:39:47.837991 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:47.837885    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv" podUID="228995b1-68ac-4b15-81ec-7627fcacfc89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 22 21:39:48.837544 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:48.837509    2583 patch_prober.go:28] interesting pod/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 22 21:39:48.837942 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:48.837564    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv" podUID="228995b1-68ac-4b15-81ec-7627fcacfc89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 22 21:39:49.233082 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:49.233043    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:49.836691 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:49.836648    2583 patch_prober.go:28] interesting pod/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 22 21:39:49.836885 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:49.836718    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv" podUID="228995b1-68ac-4b15-81ec-7627fcacfc89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 22 21:39:50.837377 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:50.837341    2583 patch_prober.go:28] interesting pod/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 22 21:39:50.837774 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:50.837397    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv" podUID="228995b1-68ac-4b15-81ec-7627fcacfc89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 22 21:39:51.840485 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:51.840456    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:51.841402 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:51.841382    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:39:57.316256 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:57.316214    2583 patch_prober.go:28] interesting pod/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 22 21:39:57.316642 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:57.316270    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs" podUID="b2e33d87-8468-4129-8742-b91608ebdae8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 22 21:39:58.365175 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:58.365141    2583 generic.go:356] "Generic (PLEG): container finished" podID="b2e33d87-8468-4129-8742-b91608ebdae8" containerID="3af85b2d159e1334357aeb1e9a798d314b0cf19a9789b5a2e7f78cbc8e8a6756" exitCode=0
Jul 22 21:39:58.365553 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:58.365215    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs" event={"ID":"b2e33d87-8468-4129-8742-b91608ebdae8","Type":"ContainerDied","Data":"3af85b2d159e1334357aeb1e9a798d314b0cf19a9789b5a2e7f78cbc8e8a6756"}
Jul 22 21:39:58.365553 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:58.365522    2583 scope.go:117] "RemoveContainer" containerID="3af85b2d159e1334357aeb1e9a798d314b0cf19a9789b5a2e7f78cbc8e8a6756"
Jul 22 21:39:58.366534 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:58.366511    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:39:58.366594 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:58.366570    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:39:58.366638 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:58.366614    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 21:39:59.373004 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:59.372968    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs" event={"ID":"b2e33d87-8468-4129-8742-b91608ebdae8","Type":"ContainerStarted","Data":"d23495a6678efd6a2c9ffe5345dc137c198737eedccf82e3a35d3aff113ab76f"}
Jul 22 21:39:59.550734 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:59.550698    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:39:59.550917 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:59.550898    2583 patch_prober.go:28] interesting pod/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 22 21:39:59.550965 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:39:59.550941    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs" podUID="b2e33d87-8468-4129-8742-b91608ebdae8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 22 21:40:00.298413 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.298383    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"]
Jul 22 21:40:00.298770 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.298758    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c7632e1-e113-4cfc-b472-f0daeaa9e1f9" containerName="istio-proxy"
Jul 22 21:40:00.301936 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.301920    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:40:00.307795 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.307770    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-644efc\"/\"openshift-service-ca.crt\""
Jul 22 21:40:00.307942 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.307770    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-644efc\"/\"kube-root-ca.crt\""
Jul 22 21:40:00.307942 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.307773    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-644efc\"/\"auth-test-model-644efc-kserve-self-signed-certs\""
Jul 22 21:40:00.307942 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.307772    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-644efc\"/\"default-dockercfg-l7r26\""
Jul 22 21:40:00.312151 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.312129    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"]
Jul 22 21:40:00.437984 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.437953    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-tls-certs\") pod \"auth-test-model-644efc-kserve-6898d9f76c-jftd9\" (UID: \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\") " pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:40:00.438358 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.437997    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-model-cache\") pod \"auth-test-model-644efc-kserve-6898d9f76c-jftd9\" (UID: \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\") " pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:40:00.438358 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.438033    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-dshm\") pod \"auth-test-model-644efc-kserve-6898d9f76c-jftd9\" (UID: \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\") " pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:40:00.438358 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.438084    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-home\") pod \"auth-test-model-644efc-kserve-6898d9f76c-jftd9\" (UID: \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\") " pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:40:00.438358 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.438178    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-tmp-dir\") pod \"auth-test-model-644efc-kserve-6898d9f76c-jftd9\" (UID: \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\") " pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:40:00.438358 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.438205    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x9np\" (UniqueName: \"kubernetes.io/projected/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-kube-api-access-5x9np\") pod \"auth-test-model-644efc-kserve-6898d9f76c-jftd9\" (UID: \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\") " pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:40:00.539179 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.539150    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-tls-certs\") pod \"auth-test-model-644efc-kserve-6898d9f76c-jftd9\" (UID: \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\") " pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:40:00.539316 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.539205    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-model-cache\") pod \"auth-test-model-644efc-kserve-6898d9f76c-jftd9\" (UID: \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\") " pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:40:00.539316 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.539264    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-dshm\") pod \"auth-test-model-644efc-kserve-6898d9f76c-jftd9\" (UID: \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\") " pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:40:00.539316 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.539303    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-home\") pod \"auth-test-model-644efc-kserve-6898d9f76c-jftd9\" (UID: \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\") " pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:40:00.539481 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.539349    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-tmp-dir\") pod \"auth-test-model-644efc-kserve-6898d9f76c-jftd9\" (UID: \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\") " pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:40:00.539481 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.539378    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x9np\" (UniqueName: \"kubernetes.io/projected/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-kube-api-access-5x9np\") pod \"auth-test-model-644efc-kserve-6898d9f76c-jftd9\" (UID: \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\") " pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:40:00.539960 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.539940    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-home\") pod \"auth-test-model-644efc-kserve-6898d9f76c-jftd9\" (UID: \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\") " pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:40:00.540061 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.539977    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-tmp-dir\") pod \"auth-test-model-644efc-kserve-6898d9f76c-jftd9\" (UID: \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\") " pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:40:00.540130 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.539977    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-model-cache\") pod \"auth-test-model-644efc-kserve-6898d9f76c-jftd9\" (UID: \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\") " pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:40:00.541793 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.541766    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-dshm\") pod \"auth-test-model-644efc-kserve-6898d9f76c-jftd9\" (UID: \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\") " pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:40:00.541793 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.541782    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-tls-certs\") pod \"auth-test-model-644efc-kserve-6898d9f76c-jftd9\" (UID: \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\") " pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:40:00.547628 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.547607    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x9np\" (UniqueName: \"kubernetes.io/projected/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-kube-api-access-5x9np\") pod \"auth-test-model-644efc-kserve-6898d9f76c-jftd9\" (UID: \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\") " pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:40:00.550677 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.550625    2583 patch_prober.go:28] interesting pod/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 22 21:40:00.550774 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.550677    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs" podUID="b2e33d87-8468-4129-8742-b91608ebdae8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 22 21:40:00.610881 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.610847    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:40:00.778488 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:00.778421    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"]
Jul 22 21:40:00.782844 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:40:00.782814    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07f6f62c_dec2_4fe5_bf3c_cfc9086412f3.slice/crio-e31432450d2b7bf00cbf1ce6430b5b924a71e2b5af841c9fbe84b30ec4e98d4d WatchSource:0}: Error finding container e31432450d2b7bf00cbf1ce6430b5b924a71e2b5af841c9fbe84b30ec4e98d4d: Status 404 returned error can't find the container with id e31432450d2b7bf00cbf1ce6430b5b924a71e2b5af841c9fbe84b30ec4e98d4d
Jul 22 21:40:01.387424 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:01.387390    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9" event={"ID":"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3","Type":"ContainerStarted","Data":"91c9ed1c487b56a358253a3a1a64404fe15d670b38039b81b3add60e52882eec"}
Jul 22 21:40:01.387424 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:01.387432    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9" event={"ID":"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3","Type":"ContainerStarted","Data":"e31432450d2b7bf00cbf1ce6430b5b924a71e2b5af841c9fbe84b30ec4e98d4d"}
Jul 22 21:40:01.404165 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:01.404096    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9" podStartSLOduration=1.404081537 podStartE2EDuration="1.404081537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:40:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:40:01.402308392 +0000 UTC m=+2599.426346965" watchObservedRunningTime="2026-07-22 21:40:01.404081537 +0000 UTC m=+2599.428120115"
Jul 22 21:40:01.551413 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:01.551384    2583 patch_prober.go:28] interesting pod/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 22 21:40:01.551810 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:01.551434    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs" podUID="b2e33d87-8468-4129-8742-b91608ebdae8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 22 21:40:02.550976 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:02.550939    2583 patch_prober.go:28] interesting pod/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 22 21:40:02.551193 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:02.550992    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs" podUID="b2e33d87-8468-4129-8742-b91608ebdae8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 22 21:40:03.554502 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:03.554425    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:40:03.554926 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:03.554808    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:40:03.555555 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:03.555534    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:40:10.611901 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:10.611858    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:40:10.612459 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:10.611939    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:40:10.624662 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:10.624637    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:40:11.449965 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:40:11.449935    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:42:14.477130 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:14.477079    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"]
Jul 22 21:42:29.498072 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:29.498029    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9" podUID="07f6f62c-dec2-4fe5-bf3c-cfc9086412f3" containerName="main" containerID="cri-o://91c9ed1c487b56a358253a3a1a64404fe15d670b38039b81b3add60e52882eec" gracePeriod=45
Jul 22 21:42:29.745090 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:29.745063    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:42:29.794476 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:29.794412    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-model-cache\") pod \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\" (UID: \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\") "
Jul 22 21:42:29.794476 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:29.794443    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5x9np\" (UniqueName: \"kubernetes.io/projected/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-kube-api-access-5x9np\") pod \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\" (UID: \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\") "
Jul 22 21:42:29.794637 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:29.794504    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-tls-certs\") pod \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\" (UID: \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\") "
Jul 22 21:42:29.794637 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:29.794533    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-tmp-dir\") pod \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\" (UID: \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\") "
Jul 22 21:42:29.794637 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:29.794621    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-dshm\") pod \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\" (UID: \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\") "
Jul 22 21:42:29.794777 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:29.794645    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-home\") pod \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\" (UID: \"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3\") "
Jul 22 21:42:29.794777 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:29.794659    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-model-cache" (OuterVolumeSpecName: "model-cache") pod "07f6f62c-dec2-4fe5-bf3c-cfc9086412f3" (UID: "07f6f62c-dec2-4fe5-bf3c-cfc9086412f3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:42:29.794887 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:29.794833    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "07f6f62c-dec2-4fe5-bf3c-cfc9086412f3" (UID: "07f6f62c-dec2-4fe5-bf3c-cfc9086412f3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:42:29.794966 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:29.794945    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-home" (OuterVolumeSpecName: "home") pod "07f6f62c-dec2-4fe5-bf3c-cfc9086412f3" (UID: "07f6f62c-dec2-4fe5-bf3c-cfc9086412f3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:42:29.795041 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:29.795016    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-model-cache\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:42:29.795181 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:29.795044    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-tmp-dir\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:42:29.795409 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:29.795242    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-home\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:42:29.796777 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:29.796754    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-kube-api-access-5x9np" (OuterVolumeSpecName: "kube-api-access-5x9np") pod "07f6f62c-dec2-4fe5-bf3c-cfc9086412f3" (UID: "07f6f62c-dec2-4fe5-bf3c-cfc9086412f3"). InnerVolumeSpecName "kube-api-access-5x9np". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:42:29.796875 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:29.796786    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "07f6f62c-dec2-4fe5-bf3c-cfc9086412f3" (UID: "07f6f62c-dec2-4fe5-bf3c-cfc9086412f3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:42:29.796875 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:29.796859    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-dshm" (OuterVolumeSpecName: "dshm") pod "07f6f62c-dec2-4fe5-bf3c-cfc9086412f3" (UID: "07f6f62c-dec2-4fe5-bf3c-cfc9086412f3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:42:29.896533 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:29.896513    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-tls-certs\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:42:29.896533 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:29.896534    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-dshm\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:42:29.896670 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:29.896543    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5x9np\" (UniqueName: \"kubernetes.io/projected/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3-kube-api-access-5x9np\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:42:30.118254 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:30.118225    2583 generic.go:356] "Generic (PLEG): container finished" podID="07f6f62c-dec2-4fe5-bf3c-cfc9086412f3" containerID="91c9ed1c487b56a358253a3a1a64404fe15d670b38039b81b3add60e52882eec" exitCode=0
Jul 22 21:42:30.118400 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:30.118268    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9" event={"ID":"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3","Type":"ContainerDied","Data":"91c9ed1c487b56a358253a3a1a64404fe15d670b38039b81b3add60e52882eec"}
Jul 22 21:42:30.118400 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:30.118294    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"
Jul 22 21:42:30.118400 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:30.118336    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9" event={"ID":"07f6f62c-dec2-4fe5-bf3c-cfc9086412f3","Type":"ContainerDied","Data":"e31432450d2b7bf00cbf1ce6430b5b924a71e2b5af841c9fbe84b30ec4e98d4d"}
Jul 22 21:42:30.118400 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:30.118362    2583 scope.go:117] "RemoveContainer" containerID="91c9ed1c487b56a358253a3a1a64404fe15d670b38039b81b3add60e52882eec"
Jul 22 21:42:30.128954 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:30.128936    2583 scope.go:117] "RemoveContainer" containerID="91c9ed1c487b56a358253a3a1a64404fe15d670b38039b81b3add60e52882eec"
Jul 22 21:42:30.129280 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:42:30.129256    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91c9ed1c487b56a358253a3a1a64404fe15d670b38039b81b3add60e52882eec\": container with ID starting with 91c9ed1c487b56a358253a3a1a64404fe15d670b38039b81b3add60e52882eec not found: ID does not exist" containerID="91c9ed1c487b56a358253a3a1a64404fe15d670b38039b81b3add60e52882eec"
Jul 22 21:42:30.129359 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:30.129289    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91c9ed1c487b56a358253a3a1a64404fe15d670b38039b81b3add60e52882eec"} err="failed to get container status \"91c9ed1c487b56a358253a3a1a64404fe15d670b38039b81b3add60e52882eec\": rpc error: code = NotFound desc = could not find container \"91c9ed1c487b56a358253a3a1a64404fe15d670b38039b81b3add60e52882eec\": container with ID starting with 91c9ed1c487b56a358253a3a1a64404fe15d670b38039b81b3add60e52882eec not found: ID does not exist"
Jul 22 21:42:30.141089 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:30.141063    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"]
Jul 22 21:42:30.145517 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:30.145492    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-644efc/auth-test-model-644efc-kserve-6898d9f76c-jftd9"]
Jul 22 21:42:30.410401 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:30.410328    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07f6f62c-dec2-4fe5-bf3c-cfc9086412f3" path="/var/lib/kubelet/pods/07f6f62c-dec2-4fe5-bf3c-cfc9086412f3/volumes"
Jul 22 21:42:32.410155 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.410127    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"]
Jul 22 21:42:32.410528 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.410444    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07f6f62c-dec2-4fe5-bf3c-cfc9086412f3" containerName="main"
Jul 22 21:42:32.410528 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.410457    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="07f6f62c-dec2-4fe5-bf3c-cfc9086412f3" containerName="main"
Jul 22 21:42:32.410528 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.410519    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="07f6f62c-dec2-4fe5-bf3c-cfc9086412f3" containerName="main"
Jul 22 21:42:32.414793 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.414776    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:42:32.418206 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.418181    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-644efc\"/\"default-dockercfg-l7r26\""
Jul 22 21:42:32.418440 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.418234    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-644efc\"/\"kube-root-ca.crt\""
Jul 22 21:42:32.418440 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.418314    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-644efc\"/\"openshift-service-ca.crt\""
Jul 22 21:42:32.418440 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.418234    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-644efc\"/\"sub-test-model-644efc-kserve-self-signed-certs\""
Jul 22 21:42:32.421203 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.421180    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"]
Jul 22 21:42:32.516388 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.516359    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-model-cache\") pod \"sub-test-model-644efc-kserve-6b945c5547-g4fz5\" (UID: \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\") " pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:42:32.516523 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.516394    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgtg9\" (UniqueName: \"kubernetes.io/projected/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-kube-api-access-hgtg9\") pod \"sub-test-model-644efc-kserve-6b945c5547-g4fz5\" (UID: \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\") " pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:42:32.516523 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.516430    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-tls-certs\") pod \"sub-test-model-644efc-kserve-6b945c5547-g4fz5\" (UID: \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\") " pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:42:32.516601 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.516515    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-home\") pod \"sub-test-model-644efc-kserve-6b945c5547-g4fz5\" (UID: \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\") " pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:42:32.516601 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.516542    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-tmp-dir\") pod \"sub-test-model-644efc-kserve-6b945c5547-g4fz5\" (UID: \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\") " pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:42:32.516601 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.516578    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-dshm\") pod \"sub-test-model-644efc-kserve-6b945c5547-g4fz5\" (UID: \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\") " pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:42:32.617438 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.617402    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgtg9\" (UniqueName: \"kubernetes.io/projected/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-kube-api-access-hgtg9\") pod \"sub-test-model-644efc-kserve-6b945c5547-g4fz5\" (UID: \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\") " pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:42:32.617580 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.617458    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-tls-certs\") pod \"sub-test-model-644efc-kserve-6b945c5547-g4fz5\" (UID: \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\") " pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:42:32.617580 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.617491    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-home\") pod \"sub-test-model-644efc-kserve-6b945c5547-g4fz5\" (UID: \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\") " pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:42:32.617580 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.617508    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-tmp-dir\") pod \"sub-test-model-644efc-kserve-6b945c5547-g4fz5\" (UID: \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\") " pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:42:32.617580 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.617538    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-dshm\") pod \"sub-test-model-644efc-kserve-6b945c5547-g4fz5\" (UID: \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\") " pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:42:32.617580 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.617573    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-model-cache\") pod \"sub-test-model-644efc-kserve-6b945c5547-g4fz5\" (UID: \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\") " pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:42:32.617958 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.617936    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-home\") pod \"sub-test-model-644efc-kserve-6b945c5547-g4fz5\" (UID: \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\") " pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:42:32.617997 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.617953    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-tmp-dir\") pod \"sub-test-model-644efc-kserve-6b945c5547-g4fz5\" (UID: \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\") " pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:42:32.618063 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.618045    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-model-cache\") pod \"sub-test-model-644efc-kserve-6b945c5547-g4fz5\" (UID: \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\") " pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:42:32.620002 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.619979    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-dshm\") pod \"sub-test-model-644efc-kserve-6b945c5547-g4fz5\" (UID: \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\") " pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:42:32.620272 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.620258    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-tls-certs\") pod \"sub-test-model-644efc-kserve-6b945c5547-g4fz5\" (UID: \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\") " pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:42:32.626222 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.626197    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgtg9\" (UniqueName: \"kubernetes.io/projected/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-kube-api-access-hgtg9\") pod \"sub-test-model-644efc-kserve-6b945c5547-g4fz5\" (UID: \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\") " pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:42:32.725123 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.725024    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:42:32.857764 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:32.857708    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"]
Jul 22 21:42:32.866928 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:42:32.866883    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4eba3f5_239b_46ef_b048_7d7e7aca43e8.slice/crio-a6191cb3337e7cfd6b253a91f5aaca8345cc40d46fd081fd60de3d4e6af0c201 WatchSource:0}: Error finding container a6191cb3337e7cfd6b253a91f5aaca8345cc40d46fd081fd60de3d4e6af0c201: Status 404 returned error can't find the container with id a6191cb3337e7cfd6b253a91f5aaca8345cc40d46fd081fd60de3d4e6af0c201
Jul 22 21:42:33.134666 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:33.134628    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5" event={"ID":"c4eba3f5-239b-46ef-b048-7d7e7aca43e8","Type":"ContainerStarted","Data":"4ccc07c2f0c1770071ee1b293b665220362cde4ce0654da265349f9d1009f3d9"}
Jul 22 21:42:33.134836 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:33.134678    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5" event={"ID":"c4eba3f5-239b-46ef-b048-7d7e7aca43e8","Type":"ContainerStarted","Data":"a6191cb3337e7cfd6b253a91f5aaca8345cc40d46fd081fd60de3d4e6af0c201"}
Jul 22 21:42:42.726174 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:42.726139    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:42:42.726539 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:42.726190    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:42:42.738260 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:42.738240    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:42:42.756506 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:42.756463    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5" podStartSLOduration=10.756450559 podStartE2EDuration="10.756450559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:42:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:42:33.153022656 +0000 UTC m=+2751.177061236" watchObservedRunningTime="2026-07-22 21:42:42.756450559 +0000 UTC m=+2760.780489137"
Jul 22 21:42:43.192626 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:42:43.192601    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:43:42.689675 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:43:42.689645    2583 scope.go:117] "RemoveContainer" containerID="2d4077497a73abf651870f03e19d158be1f75c5d087d0f1846beff856e18da96"
Jul 22 21:43:53.410163 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:43:53.410131    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"]
Jul 22 21:44:08.012941 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.012908    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"]
Jul 22 21:44:08.016057 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.016039    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:44:08.018462 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.018440    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-644efc\"/\"rate-test-model-644efc-kserve-self-signed-certs\""
Jul 22 21:44:08.029005 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.028984    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"]
Jul 22 21:44:08.201916 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.201886    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0d64802-bb54-453c-b117-08670c71086c-tls-certs\") pod \"rate-test-model-644efc-kserve-589dd9f467-d44q5\" (UID: \"d0d64802-bb54-453c-b117-08670c71086c\") " pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:44:08.201916 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.201921    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0d64802-bb54-453c-b117-08670c71086c-tmp-dir\") pod \"rate-test-model-644efc-kserve-589dd9f467-d44q5\" (UID: \"d0d64802-bb54-453c-b117-08670c71086c\") " pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:44:08.202160 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.201951    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0d64802-bb54-453c-b117-08670c71086c-dshm\") pod \"rate-test-model-644efc-kserve-589dd9f467-d44q5\" (UID: \"d0d64802-bb54-453c-b117-08670c71086c\") " pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:44:08.202160 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.202074    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0d64802-bb54-453c-b117-08670c71086c-model-cache\") pod \"rate-test-model-644efc-kserve-589dd9f467-d44q5\" (UID: \"d0d64802-bb54-453c-b117-08670c71086c\") " pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:44:08.202160 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.202104    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2vfp\" (UniqueName: \"kubernetes.io/projected/d0d64802-bb54-453c-b117-08670c71086c-kube-api-access-w2vfp\") pod \"rate-test-model-644efc-kserve-589dd9f467-d44q5\" (UID: \"d0d64802-bb54-453c-b117-08670c71086c\") " pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:44:08.202305 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.202174    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0d64802-bb54-453c-b117-08670c71086c-home\") pod \"rate-test-model-644efc-kserve-589dd9f467-d44q5\" (UID: \"d0d64802-bb54-453c-b117-08670c71086c\") " pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:44:08.303182 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.303085    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0d64802-bb54-453c-b117-08670c71086c-model-cache\") pod \"rate-test-model-644efc-kserve-589dd9f467-d44q5\" (UID: \"d0d64802-bb54-453c-b117-08670c71086c\") " pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:44:08.303182 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.303137    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2vfp\" (UniqueName: \"kubernetes.io/projected/d0d64802-bb54-453c-b117-08670c71086c-kube-api-access-w2vfp\") pod \"rate-test-model-644efc-kserve-589dd9f467-d44q5\" (UID: \"d0d64802-bb54-453c-b117-08670c71086c\") " pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:44:08.303182 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.303163    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0d64802-bb54-453c-b117-08670c71086c-home\") pod \"rate-test-model-644efc-kserve-589dd9f467-d44q5\" (UID: \"d0d64802-bb54-453c-b117-08670c71086c\") " pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:44:08.303415 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.303193    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0d64802-bb54-453c-b117-08670c71086c-tls-certs\") pod \"rate-test-model-644efc-kserve-589dd9f467-d44q5\" (UID: \"d0d64802-bb54-453c-b117-08670c71086c\") " pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:44:08.303415 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.303213    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0d64802-bb54-453c-b117-08670c71086c-tmp-dir\") pod \"rate-test-model-644efc-kserve-589dd9f467-d44q5\" (UID: \"d0d64802-bb54-453c-b117-08670c71086c\") " pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:44:08.303415 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.303240    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0d64802-bb54-453c-b117-08670c71086c-dshm\") pod \"rate-test-model-644efc-kserve-589dd9f467-d44q5\" (UID: \"d0d64802-bb54-453c-b117-08670c71086c\") " pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:44:08.303561 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.303518    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0d64802-bb54-453c-b117-08670c71086c-model-cache\") pod \"rate-test-model-644efc-kserve-589dd9f467-d44q5\" (UID: \"d0d64802-bb54-453c-b117-08670c71086c\") " pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:44:08.303561 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.303530    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0d64802-bb54-453c-b117-08670c71086c-home\") pod \"rate-test-model-644efc-kserve-589dd9f467-d44q5\" (UID: \"d0d64802-bb54-453c-b117-08670c71086c\") " pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:44:08.303626 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.303569    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0d64802-bb54-453c-b117-08670c71086c-tmp-dir\") pod \"rate-test-model-644efc-kserve-589dd9f467-d44q5\" (UID: \"d0d64802-bb54-453c-b117-08670c71086c\") " pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:44:08.305591 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.305571    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0d64802-bb54-453c-b117-08670c71086c-dshm\") pod \"rate-test-model-644efc-kserve-589dd9f467-d44q5\" (UID: \"d0d64802-bb54-453c-b117-08670c71086c\") " pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:44:08.305767 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.305742    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0d64802-bb54-453c-b117-08670c71086c-tls-certs\") pod \"rate-test-model-644efc-kserve-589dd9f467-d44q5\" (UID: \"d0d64802-bb54-453c-b117-08670c71086c\") " pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:44:08.311187 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.311165    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2vfp\" (UniqueName: \"kubernetes.io/projected/d0d64802-bb54-453c-b117-08670c71086c-kube-api-access-w2vfp\") pod \"rate-test-model-644efc-kserve-589dd9f467-d44q5\" (UID: \"d0d64802-bb54-453c-b117-08670c71086c\") " pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:44:08.325093 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.325071    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:44:08.429789 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.429680    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5" podUID="c4eba3f5-239b-46ef-b048-7d7e7aca43e8" containerName="main" containerID="cri-o://4ccc07c2f0c1770071ee1b293b665220362cde4ce0654da265349f9d1009f3d9" gracePeriod=45
Jul 22 21:44:08.450035 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.450012    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"]
Jul 22 21:44:08.501989 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:44:08.501961    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0d64802_bb54_453c_b117_08670c71086c.slice/crio-4a4c6a20377ae2dcbda5c2c19852fb81544dd7156425d8e86a643e80c0c50502 WatchSource:0}: Error finding container 4a4c6a20377ae2dcbda5c2c19852fb81544dd7156425d8e86a643e80c0c50502: Status 404 returned error can't find the container with id 4a4c6a20377ae2dcbda5c2c19852fb81544dd7156425d8e86a643e80c0c50502
Jul 22 21:44:08.588645 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.588616    2583 generic.go:356] "Generic (PLEG): container finished" podID="c4eba3f5-239b-46ef-b048-7d7e7aca43e8" containerID="4ccc07c2f0c1770071ee1b293b665220362cde4ce0654da265349f9d1009f3d9" exitCode=0
Jul 22 21:44:08.588772 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.588680    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5" event={"ID":"c4eba3f5-239b-46ef-b048-7d7e7aca43e8","Type":"ContainerDied","Data":"4ccc07c2f0c1770071ee1b293b665220362cde4ce0654da265349f9d1009f3d9"}
Jul 22 21:44:08.590620 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.590593    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5" event={"ID":"d0d64802-bb54-453c-b117-08670c71086c","Type":"ContainerStarted","Data":"4a4c6a20377ae2dcbda5c2c19852fb81544dd7156425d8e86a643e80c0c50502"}
Jul 22 21:44:08.663423 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.663400    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:44:08.808401 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.808373    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-home\") pod \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\" (UID: \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\") "
Jul 22 21:44:08.808539 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.808447    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-tls-certs\") pod \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\" (UID: \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\") "
Jul 22 21:44:08.808539 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.808494    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-tmp-dir\") pod \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\" (UID: \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\") "
Jul 22 21:44:08.808539 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.808531    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-dshm\") pod \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\" (UID: \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\") "
Jul 22 21:44:08.808663 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.808557    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgtg9\" (UniqueName: \"kubernetes.io/projected/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-kube-api-access-hgtg9\") pod \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\" (UID: \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\") "
Jul 22 21:44:08.808663 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.808591    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-model-cache\") pod \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\" (UID: \"c4eba3f5-239b-46ef-b048-7d7e7aca43e8\") "
Jul 22 21:44:08.808663 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.808639    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-home" (OuterVolumeSpecName: "home") pod "c4eba3f5-239b-46ef-b048-7d7e7aca43e8" (UID: "c4eba3f5-239b-46ef-b048-7d7e7aca43e8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:44:08.808814 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.808779    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c4eba3f5-239b-46ef-b048-7d7e7aca43e8" (UID: "c4eba3f5-239b-46ef-b048-7d7e7aca43e8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:44:08.808905 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.808884    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-model-cache" (OuterVolumeSpecName: "model-cache") pod "c4eba3f5-239b-46ef-b048-7d7e7aca43e8" (UID: "c4eba3f5-239b-46ef-b048-7d7e7aca43e8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:44:08.809014 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.808892    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-home\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:44:08.809014 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.808941    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-tmp-dir\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:44:08.810631 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.810611    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-dshm" (OuterVolumeSpecName: "dshm") pod "c4eba3f5-239b-46ef-b048-7d7e7aca43e8" (UID: "c4eba3f5-239b-46ef-b048-7d7e7aca43e8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:44:08.810698 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.810656    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-kube-api-access-hgtg9" (OuterVolumeSpecName: "kube-api-access-hgtg9") pod "c4eba3f5-239b-46ef-b048-7d7e7aca43e8" (UID: "c4eba3f5-239b-46ef-b048-7d7e7aca43e8"). InnerVolumeSpecName "kube-api-access-hgtg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:44:08.810698 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.810666    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c4eba3f5-239b-46ef-b048-7d7e7aca43e8" (UID: "c4eba3f5-239b-46ef-b048-7d7e7aca43e8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:44:08.909810 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.909788    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-tls-certs\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:44:08.909810 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.909809    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-dshm\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:44:08.909929 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.909817    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgtg9\" (UniqueName: \"kubernetes.io/projected/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-kube-api-access-hgtg9\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:44:08.909929 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:08.909827    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4eba3f5-239b-46ef-b048-7d7e7aca43e8-model-cache\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:44:09.595927 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:09.595907    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"
Jul 22 21:44:09.595927 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:09.595914    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5" event={"ID":"c4eba3f5-239b-46ef-b048-7d7e7aca43e8","Type":"ContainerDied","Data":"a6191cb3337e7cfd6b253a91f5aaca8345cc40d46fd081fd60de3d4e6af0c201"}
Jul 22 21:44:09.596435 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:09.595957    2583 scope.go:117] "RemoveContainer" containerID="4ccc07c2f0c1770071ee1b293b665220362cde4ce0654da265349f9d1009f3d9"
Jul 22 21:44:09.597564 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:09.597543    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5" event={"ID":"d0d64802-bb54-453c-b117-08670c71086c","Type":"ContainerStarted","Data":"37c5ca4c387258e4400518140cc7d115ccafd1efe946ab8a978a516d87f3c634"}
Jul 22 21:44:09.613890 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:09.613852    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5" podStartSLOduration=2.613840014 podStartE2EDuration="2.613840014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:44:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:44:09.613343291 +0000 UTC m=+2847.637381869" watchObservedRunningTime="2026-07-22 21:44:09.613840014 +0000 UTC m=+2847.637878592"
Jul 22 21:44:09.626364 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:09.626344    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"]
Jul 22 21:44:09.628641 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:09.628623    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-644efc/sub-test-model-644efc-kserve-6b945c5547-g4fz5"]
Jul 22 21:44:10.415528 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:10.410383    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4eba3f5-239b-46ef-b048-7d7e7aca43e8" path="/var/lib/kubelet/pods/c4eba3f5-239b-46ef-b048-7d7e7aca43e8/volumes"
Jul 22 21:44:18.325802 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:18.325762    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:44:18.326277 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:18.325812    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:44:18.337696 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:18.337674    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:44:18.655149 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:18.655120    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:44:42.708044 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:42.707978    2583 scope.go:117] "RemoveContainer" containerID="a145457ca8ca9b8129b778e9f369b8b06d81a2f11d2ccf5d62238dd0e72659bb"
Jul 22 21:44:42.716210 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:42.716194    2583 scope.go:117] "RemoveContainer" containerID="a988cbe50e64bfbb7e5c156244569ce8835d0dadc8520dd3f55cb44601864686"
Jul 22 21:44:42.723567 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:44:42.723550    2583 scope.go:117] "RemoveContainer" containerID="672db0856c861fc45acd635e23c5adb26faa1a627b79ab4895891d0d8c6a5560"
Jul 22 21:45:02.296181 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.296141    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"]
Jul 22 21:45:02.298490 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.296558    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4eba3f5-239b-46ef-b048-7d7e7aca43e8" containerName="main"
Jul 22 21:45:02.298490 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.296579    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4eba3f5-239b-46ef-b048-7d7e7aca43e8" containerName="main"
Jul 22 21:45:02.298490 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.296675    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4eba3f5-239b-46ef-b048-7d7e7aca43e8" containerName="main"
Jul 22 21:45:02.299701 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.299687    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:45:02.302226 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.302203    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bfd0ef\"/\"openshift-service-ca.crt\""
Jul 22 21:45:02.302354 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.302221    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bfd0ef\"/\"default-dockercfg-48ntt\""
Jul 22 21:45:02.303009 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.302988    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bfd0ef\"/\"kube-root-ca.crt\""
Jul 22 21:45:02.303143 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.303102    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bfd0ef\"/\"rate-test-model-bfd0ef-kserve-self-signed-certs\""
Jul 22 21:45:02.308838 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.308817    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"]
Jul 22 21:45:02.453476 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.453447    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a986396-7299-4c3c-b538-84284d343057-home\") pod \"rate-test-model-bfd0ef-kserve-868559bb75-gmcwv\" (UID: \"2a986396-7299-4c3c-b538-84284d343057\") " pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:45:02.453650 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.453489    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgtw6\" (UniqueName: \"kubernetes.io/projected/2a986396-7299-4c3c-b538-84284d343057-kube-api-access-hgtw6\") pod \"rate-test-model-bfd0ef-kserve-868559bb75-gmcwv\" (UID: \"2a986396-7299-4c3c-b538-84284d343057\") " pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:45:02.453650 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.453519    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a986396-7299-4c3c-b538-84284d343057-model-cache\") pod \"rate-test-model-bfd0ef-kserve-868559bb75-gmcwv\" (UID: \"2a986396-7299-4c3c-b538-84284d343057\") " pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:45:02.453650 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.453584    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a986396-7299-4c3c-b538-84284d343057-tls-certs\") pod \"rate-test-model-bfd0ef-kserve-868559bb75-gmcwv\" (UID: \"2a986396-7299-4c3c-b538-84284d343057\") " pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:45:02.453650 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.453639    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a986396-7299-4c3c-b538-84284d343057-tmp-dir\") pod \"rate-test-model-bfd0ef-kserve-868559bb75-gmcwv\" (UID: \"2a986396-7299-4c3c-b538-84284d343057\") " pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:45:02.453821 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.453678    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a986396-7299-4c3c-b538-84284d343057-dshm\") pod \"rate-test-model-bfd0ef-kserve-868559bb75-gmcwv\" (UID: \"2a986396-7299-4c3c-b538-84284d343057\") " pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:45:02.554850 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.554776    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a986396-7299-4c3c-b538-84284d343057-dshm\") pod \"rate-test-model-bfd0ef-kserve-868559bb75-gmcwv\" (UID: \"2a986396-7299-4c3c-b538-84284d343057\") " pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:45:02.554850 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.554835    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a986396-7299-4c3c-b538-84284d343057-home\") pod \"rate-test-model-bfd0ef-kserve-868559bb75-gmcwv\" (UID: \"2a986396-7299-4c3c-b538-84284d343057\") " pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:45:02.555048 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.554876    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgtw6\" (UniqueName: \"kubernetes.io/projected/2a986396-7299-4c3c-b538-84284d343057-kube-api-access-hgtw6\") pod \"rate-test-model-bfd0ef-kserve-868559bb75-gmcwv\" (UID: \"2a986396-7299-4c3c-b538-84284d343057\") " pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:45:02.555048 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.554914    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a986396-7299-4c3c-b538-84284d343057-model-cache\") pod \"rate-test-model-bfd0ef-kserve-868559bb75-gmcwv\" (UID: \"2a986396-7299-4c3c-b538-84284d343057\") " pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:45:02.555048 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.554970    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a986396-7299-4c3c-b538-84284d343057-tls-certs\") pod \"rate-test-model-bfd0ef-kserve-868559bb75-gmcwv\" (UID: \"2a986396-7299-4c3c-b538-84284d343057\") " pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:45:02.555048 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.555008    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a986396-7299-4c3c-b538-84284d343057-tmp-dir\") pod \"rate-test-model-bfd0ef-kserve-868559bb75-gmcwv\" (UID: \"2a986396-7299-4c3c-b538-84284d343057\") " pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:45:02.555296 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.555271    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a986396-7299-4c3c-b538-84284d343057-home\") pod \"rate-test-model-bfd0ef-kserve-868559bb75-gmcwv\" (UID: \"2a986396-7299-4c3c-b538-84284d343057\") " pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:45:02.555362 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.555333    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a986396-7299-4c3c-b538-84284d343057-model-cache\") pod \"rate-test-model-bfd0ef-kserve-868559bb75-gmcwv\" (UID: \"2a986396-7299-4c3c-b538-84284d343057\") " pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:45:02.555406 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.555368    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a986396-7299-4c3c-b538-84284d343057-tmp-dir\") pod \"rate-test-model-bfd0ef-kserve-868559bb75-gmcwv\" (UID: \"2a986396-7299-4c3c-b538-84284d343057\") " pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:45:02.557209 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.557188    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a986396-7299-4c3c-b538-84284d343057-dshm\") pod \"rate-test-model-bfd0ef-kserve-868559bb75-gmcwv\" (UID: \"2a986396-7299-4c3c-b538-84284d343057\") " pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:45:02.557460 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.557442    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a986396-7299-4c3c-b538-84284d343057-tls-certs\") pod \"rate-test-model-bfd0ef-kserve-868559bb75-gmcwv\" (UID: \"2a986396-7299-4c3c-b538-84284d343057\") " pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:45:02.563127 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.563090    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgtw6\" (UniqueName: \"kubernetes.io/projected/2a986396-7299-4c3c-b538-84284d343057-kube-api-access-hgtw6\") pod \"rate-test-model-bfd0ef-kserve-868559bb75-gmcwv\" (UID: \"2a986396-7299-4c3c-b538-84284d343057\") " pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:45:02.609529 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.609508    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:45:02.741429 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.741401    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"]
Jul 22 21:45:02.743552 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:45:02.743521    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a986396_7299_4c3c_b538_84284d343057.slice/crio-b427bba6ffe88b78697571498076027b6290919e5e4121f859cc1a096f31b636 WatchSource:0}: Error finding container b427bba6ffe88b78697571498076027b6290919e5e4121f859cc1a096f31b636: Status 404 returned error can't find the container with id b427bba6ffe88b78697571498076027b6290919e5e4121f859cc1a096f31b636
Jul 22 21:45:02.837786 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.837708    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv" event={"ID":"2a986396-7299-4c3c-b538-84284d343057","Type":"ContainerStarted","Data":"fe787b9b592ae89e5568fe364ad7fc828a53889ac3aa54060a313dfc500bc87d"}
Jul 22 21:45:02.837786 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.837768    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv" event={"ID":"2a986396-7299-4c3c-b538-84284d343057","Type":"ContainerStarted","Data":"b427bba6ffe88b78697571498076027b6290919e5e4121f859cc1a096f31b636"}
Jul 22 21:45:02.854624 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:02.854512    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv" podStartSLOduration=0.854497284 podStartE2EDuration="854.497284ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:45:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:45:02.852892952 +0000 UTC m=+2900.876931531" watchObservedRunningTime="2026-07-22 21:45:02.854497284 +0000 UTC m=+2900.878535862"
Jul 22 21:45:12.610209 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:12.610169    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:45:12.610642 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:12.610223    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:45:12.622989 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:12.622961    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:45:12.894133 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:12.894025    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:45:42.749724 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:42.749695    2583 scope.go:117] "RemoveContainer" containerID="2e69b5dd0bfadffc2c2d84d94da39143cd3efa693e3ef7a048ae4b59e6fb5ed7"
Jul 22 21:45:51.612262 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:51.612224    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"]
Jul 22 21:45:52.385134 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:45:52.385074    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"]
Jul 22 21:46:06.633145 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:06.633040    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5" podUID="d0d64802-bb54-453c-b117-08670c71086c" containerName="main" containerID="cri-o://37c5ca4c387258e4400518140cc7d115ccafd1efe946ab8a978a516d87f3c634" gracePeriod=45
Jul 22 21:46:06.881428 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:06.881399    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:46:06.923021 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:06.922927    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0d64802-bb54-453c-b117-08670c71086c-tmp-dir\") pod \"d0d64802-bb54-453c-b117-08670c71086c\" (UID: \"d0d64802-bb54-453c-b117-08670c71086c\") "
Jul 22 21:46:06.923021 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:06.922982    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0d64802-bb54-453c-b117-08670c71086c-home\") pod \"d0d64802-bb54-453c-b117-08670c71086c\" (UID: \"d0d64802-bb54-453c-b117-08670c71086c\") "
Jul 22 21:46:06.923021 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:06.923018    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0d64802-bb54-453c-b117-08670c71086c-model-cache\") pod \"d0d64802-bb54-453c-b117-08670c71086c\" (UID: \"d0d64802-bb54-453c-b117-08670c71086c\") "
Jul 22 21:46:06.923335 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:06.923077    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0d64802-bb54-453c-b117-08670c71086c-tls-certs\") pod \"d0d64802-bb54-453c-b117-08670c71086c\" (UID: \"d0d64802-bb54-453c-b117-08670c71086c\") "
Jul 22 21:46:06.923335 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:06.923124    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2vfp\" (UniqueName: \"kubernetes.io/projected/d0d64802-bb54-453c-b117-08670c71086c-kube-api-access-w2vfp\") pod \"d0d64802-bb54-453c-b117-08670c71086c\" (UID: \"d0d64802-bb54-453c-b117-08670c71086c\") "
Jul 22 21:46:06.923335 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:06.923219    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0d64802-bb54-453c-b117-08670c71086c-dshm\") pod \"d0d64802-bb54-453c-b117-08670c71086c\" (UID: \"d0d64802-bb54-453c-b117-08670c71086c\") "
Jul 22 21:46:06.923335 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:06.923222    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0d64802-bb54-453c-b117-08670c71086c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d0d64802-bb54-453c-b117-08670c71086c" (UID: "d0d64802-bb54-453c-b117-08670c71086c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:46:06.923335 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:06.923313    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0d64802-bb54-453c-b117-08670c71086c-model-cache" (OuterVolumeSpecName: "model-cache") pod "d0d64802-bb54-453c-b117-08670c71086c" (UID: "d0d64802-bb54-453c-b117-08670c71086c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:46:06.923587 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:06.923360    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0d64802-bb54-453c-b117-08670c71086c-home" (OuterVolumeSpecName: "home") pod "d0d64802-bb54-453c-b117-08670c71086c" (UID: "d0d64802-bb54-453c-b117-08670c71086c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:46:06.923587 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:06.923537    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0d64802-bb54-453c-b117-08670c71086c-home\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:46:06.923587 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:06.923556    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0d64802-bb54-453c-b117-08670c71086c-model-cache\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:46:06.923587 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:06.923570    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0d64802-bb54-453c-b117-08670c71086c-tmp-dir\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:46:06.925481 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:06.925449    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0d64802-bb54-453c-b117-08670c71086c-kube-api-access-w2vfp" (OuterVolumeSpecName: "kube-api-access-w2vfp") pod "d0d64802-bb54-453c-b117-08670c71086c" (UID: "d0d64802-bb54-453c-b117-08670c71086c"). InnerVolumeSpecName "kube-api-access-w2vfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:46:06.925871 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:06.925845    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0d64802-bb54-453c-b117-08670c71086c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d0d64802-bb54-453c-b117-08670c71086c" (UID: "d0d64802-bb54-453c-b117-08670c71086c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:46:06.925943 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:06.925847    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0d64802-bb54-453c-b117-08670c71086c-dshm" (OuterVolumeSpecName: "dshm") pod "d0d64802-bb54-453c-b117-08670c71086c" (UID: "d0d64802-bb54-453c-b117-08670c71086c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:46:07.024434 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.024393    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0d64802-bb54-453c-b117-08670c71086c-tls-certs\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:46:07.024434 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.024430    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2vfp\" (UniqueName: \"kubernetes.io/projected/d0d64802-bb54-453c-b117-08670c71086c-kube-api-access-w2vfp\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:46:07.024434 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.024445    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0d64802-bb54-453c-b117-08670c71086c-dshm\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:46:07.131426 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.131394    2583 generic.go:356] "Generic (PLEG): container finished" podID="d0d64802-bb54-453c-b117-08670c71086c" containerID="37c5ca4c387258e4400518140cc7d115ccafd1efe946ab8a978a516d87f3c634" exitCode=0
Jul 22 21:46:07.131616 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.131441    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"
Jul 22 21:46:07.131616 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.131488    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5" event={"ID":"d0d64802-bb54-453c-b117-08670c71086c","Type":"ContainerDied","Data":"37c5ca4c387258e4400518140cc7d115ccafd1efe946ab8a978a516d87f3c634"}
Jul 22 21:46:07.131616 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.131529    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5" event={"ID":"d0d64802-bb54-453c-b117-08670c71086c","Type":"ContainerDied","Data":"4a4c6a20377ae2dcbda5c2c19852fb81544dd7156425d8e86a643e80c0c50502"}
Jul 22 21:46:07.131616 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.131546    2583 scope.go:117] "RemoveContainer" containerID="37c5ca4c387258e4400518140cc7d115ccafd1efe946ab8a978a516d87f3c634"
Jul 22 21:46:07.140683 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.140664    2583 scope.go:117] "RemoveContainer" containerID="37c5ca4c387258e4400518140cc7d115ccafd1efe946ab8a978a516d87f3c634"
Jul 22 21:46:07.140971 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:46:07.140950    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37c5ca4c387258e4400518140cc7d115ccafd1efe946ab8a978a516d87f3c634\": container with ID starting with 37c5ca4c387258e4400518140cc7d115ccafd1efe946ab8a978a516d87f3c634 not found: ID does not exist" containerID="37c5ca4c387258e4400518140cc7d115ccafd1efe946ab8a978a516d87f3c634"
Jul 22 21:46:07.141019 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.140980    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37c5ca4c387258e4400518140cc7d115ccafd1efe946ab8a978a516d87f3c634"} err="failed to get container status \"37c5ca4c387258e4400518140cc7d115ccafd1efe946ab8a978a516d87f3c634\": rpc error: code = NotFound desc = could not find container \"37c5ca4c387258e4400518140cc7d115ccafd1efe946ab8a978a516d87f3c634\": container with ID starting with 37c5ca4c387258e4400518140cc7d115ccafd1efe946ab8a978a516d87f3c634 not found: ID does not exist"
Jul 22 21:46:07.151553 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.151515    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"]
Jul 22 21:46:07.158000 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.157953    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-644efc/rate-test-model-644efc-kserve-589dd9f467-d44q5"]
Jul 22 21:46:07.406166 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.406128    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv" podUID="2a986396-7299-4c3c-b538-84284d343057" containerName="main" containerID="cri-o://fe787b9b592ae89e5568fe364ad7fc828a53889ac3aa54060a313dfc500bc87d" gracePeriod=45
Jul 22 21:46:07.668605 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.668530    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:46:07.730967 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.730925    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a986396-7299-4c3c-b538-84284d343057-tls-certs\") pod \"2a986396-7299-4c3c-b538-84284d343057\" (UID: \"2a986396-7299-4c3c-b538-84284d343057\") "
Jul 22 21:46:07.731195 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.730978    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgtw6\" (UniqueName: \"kubernetes.io/projected/2a986396-7299-4c3c-b538-84284d343057-kube-api-access-hgtw6\") pod \"2a986396-7299-4c3c-b538-84284d343057\" (UID: \"2a986396-7299-4c3c-b538-84284d343057\") "
Jul 22 21:46:07.731195 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.730998    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a986396-7299-4c3c-b538-84284d343057-model-cache\") pod \"2a986396-7299-4c3c-b538-84284d343057\" (UID: \"2a986396-7299-4c3c-b538-84284d343057\") "
Jul 22 21:46:07.731195 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.731167    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a986396-7299-4c3c-b538-84284d343057-tmp-dir\") pod \"2a986396-7299-4c3c-b538-84284d343057\" (UID: \"2a986396-7299-4c3c-b538-84284d343057\") "
Jul 22 21:46:07.731399 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.731208    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a986396-7299-4c3c-b538-84284d343057-dshm\") pod \"2a986396-7299-4c3c-b538-84284d343057\" (UID: \"2a986396-7299-4c3c-b538-84284d343057\") "
Jul 22 21:46:07.731399 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.731254    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a986396-7299-4c3c-b538-84284d343057-home\") pod \"2a986396-7299-4c3c-b538-84284d343057\" (UID: \"2a986396-7299-4c3c-b538-84284d343057\") "
Jul 22 21:46:07.731399 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.731310    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a986396-7299-4c3c-b538-84284d343057-model-cache" (OuterVolumeSpecName: "model-cache") pod "2a986396-7299-4c3c-b538-84284d343057" (UID: "2a986396-7299-4c3c-b538-84284d343057"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:46:07.731399 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.731336    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a986396-7299-4c3c-b538-84284d343057-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2a986396-7299-4c3c-b538-84284d343057" (UID: "2a986396-7299-4c3c-b538-84284d343057"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:46:07.731599 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.731538    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a986396-7299-4c3c-b538-84284d343057-model-cache\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:46:07.731599 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.731553    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a986396-7299-4c3c-b538-84284d343057-tmp-dir\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:46:07.731599 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.731556    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a986396-7299-4c3c-b538-84284d343057-home" (OuterVolumeSpecName: "home") pod "2a986396-7299-4c3c-b538-84284d343057" (UID: "2a986396-7299-4c3c-b538-84284d343057"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:46:07.733513 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.733481    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a986396-7299-4c3c-b538-84284d343057-kube-api-access-hgtw6" (OuterVolumeSpecName: "kube-api-access-hgtw6") pod "2a986396-7299-4c3c-b538-84284d343057" (UID: "2a986396-7299-4c3c-b538-84284d343057"). InnerVolumeSpecName "kube-api-access-hgtw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:46:07.733513 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.733498    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a986396-7299-4c3c-b538-84284d343057-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2a986396-7299-4c3c-b538-84284d343057" (UID: "2a986396-7299-4c3c-b538-84284d343057"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:46:07.733657 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.733509    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a986396-7299-4c3c-b538-84284d343057-dshm" (OuterVolumeSpecName: "dshm") pod "2a986396-7299-4c3c-b538-84284d343057" (UID: "2a986396-7299-4c3c-b538-84284d343057"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:46:07.832480 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.832443    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a986396-7299-4c3c-b538-84284d343057-tls-certs\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:46:07.832480 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.832476    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgtw6\" (UniqueName: \"kubernetes.io/projected/2a986396-7299-4c3c-b538-84284d343057-kube-api-access-hgtw6\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:46:07.832480 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.832487    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a986396-7299-4c3c-b538-84284d343057-dshm\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:46:07.832784 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:07.832497    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a986396-7299-4c3c-b538-84284d343057-home\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:46:08.136864 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:08.136827    2583 generic.go:356] "Generic (PLEG): container finished" podID="2a986396-7299-4c3c-b538-84284d343057" containerID="fe787b9b592ae89e5568fe364ad7fc828a53889ac3aa54060a313dfc500bc87d" exitCode=0
Jul 22 21:46:08.137076 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:08.136870    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"
Jul 22 21:46:08.137076 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:08.136919    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv" event={"ID":"2a986396-7299-4c3c-b538-84284d343057","Type":"ContainerDied","Data":"fe787b9b592ae89e5568fe364ad7fc828a53889ac3aa54060a313dfc500bc87d"}
Jul 22 21:46:08.137076 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:08.136965    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv" event={"ID":"2a986396-7299-4c3c-b538-84284d343057","Type":"ContainerDied","Data":"b427bba6ffe88b78697571498076027b6290919e5e4121f859cc1a096f31b636"}
Jul 22 21:46:08.137076 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:08.136988    2583 scope.go:117] "RemoveContainer" containerID="fe787b9b592ae89e5568fe364ad7fc828a53889ac3aa54060a313dfc500bc87d"
Jul 22 21:46:08.146368 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:08.146349    2583 scope.go:117] "RemoveContainer" containerID="fe787b9b592ae89e5568fe364ad7fc828a53889ac3aa54060a313dfc500bc87d"
Jul 22 21:46:08.146659 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:46:08.146640    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe787b9b592ae89e5568fe364ad7fc828a53889ac3aa54060a313dfc500bc87d\": container with ID starting with fe787b9b592ae89e5568fe364ad7fc828a53889ac3aa54060a313dfc500bc87d not found: ID does not exist" containerID="fe787b9b592ae89e5568fe364ad7fc828a53889ac3aa54060a313dfc500bc87d"
Jul 22 21:46:08.146705 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:08.146668    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe787b9b592ae89e5568fe364ad7fc828a53889ac3aa54060a313dfc500bc87d"} err="failed to get container status \"fe787b9b592ae89e5568fe364ad7fc828a53889ac3aa54060a313dfc500bc87d\": rpc error: code = NotFound desc = could not find container \"fe787b9b592ae89e5568fe364ad7fc828a53889ac3aa54060a313dfc500bc87d\": container with ID starting with fe787b9b592ae89e5568fe364ad7fc828a53889ac3aa54060a313dfc500bc87d not found: ID does not exist"
Jul 22 21:46:08.158265 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:08.158234    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"]
Jul 22 21:46:08.163913 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:08.163884    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-bfd0ef/rate-test-model-bfd0ef-kserve-868559bb75-gmcwv"]
Jul 22 21:46:08.409852 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:08.409771    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a986396-7299-4c3c-b538-84284d343057" path="/var/lib/kubelet/pods/2a986396-7299-4c3c-b538-84284d343057/volumes"
Jul 22 21:46:08.410202 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:08.410188    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0d64802-bb54-453c-b117-08670c71086c" path="/var/lib/kubelet/pods/d0d64802-bb54-453c-b117-08670c71086c/volumes"
Jul 22 21:46:11.466476 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:11.466440    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-644efc-2xshk"]
Jul 22 21:46:11.466843 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:11.466761    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0d64802-bb54-453c-b117-08670c71086c" containerName="main"
Jul 22 21:46:11.466843 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:11.466771    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0d64802-bb54-453c-b117-08670c71086c" containerName="main"
Jul 22 21:46:11.466843 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:11.466788    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a986396-7299-4c3c-b538-84284d343057" containerName="main"
Jul 22 21:46:11.466843 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:11.466793    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a986396-7299-4c3c-b538-84284d343057" containerName="main"
Jul 22 21:46:11.466975 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:11.466846    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0d64802-bb54-453c-b117-08670c71086c" containerName="main"
Jul 22 21:46:11.466975 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:11.466853    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a986396-7299-4c3c-b538-84284d343057" containerName="main"
Jul 22 21:46:11.471423 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:11.471408    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-644efc-2xshk"
Jul 22 21:46:11.474607 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:11.474588    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zz5vc\""
Jul 22 21:46:11.490684 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:11.490660    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-644efc-2xshk"]
Jul 22 21:46:11.562447 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:11.562420    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb3add5e-7afe-4484-bd81-5f47487f7ebf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-644efc-2xshk\" (UID: \"cb3add5e-7afe-4484-bd81-5f47487f7ebf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-644efc-2xshk"
Jul 22 21:46:11.663191 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:11.663161    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb3add5e-7afe-4484-bd81-5f47487f7ebf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-644efc-2xshk\" (UID: \"cb3add5e-7afe-4484-bd81-5f47487f7ebf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-644efc-2xshk"
Jul 22 21:46:11.663776 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:11.663756    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb3add5e-7afe-4484-bd81-5f47487f7ebf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-644efc-2xshk\" (UID: \"cb3add5e-7afe-4484-bd81-5f47487f7ebf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-644efc-2xshk"
Jul 22 21:46:11.780927 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:11.780875    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-644efc-2xshk"
Jul 22 21:46:11.909020 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:11.908985    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-644efc-2xshk"]
Jul 22 21:46:11.911452 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:46:11.911427    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb3add5e_7afe_4484_bd81_5f47487f7ebf.slice/crio-8ca0a98ea72be5dad81edb690315cf687cb31049fd2dd691218c265e3fd73ae5 WatchSource:0}: Error finding container 8ca0a98ea72be5dad81edb690315cf687cb31049fd2dd691218c265e3fd73ae5: Status 404 returned error can't find the container with id 8ca0a98ea72be5dad81edb690315cf687cb31049fd2dd691218c265e3fd73ae5
Jul 22 21:46:12.157527 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:12.157497    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-644efc-2xshk" event={"ID":"cb3add5e-7afe-4484-bd81-5f47487f7ebf","Type":"ContainerStarted","Data":"f193a59d5937aaebaca6d7446cf93c424785efcc4f2bc0883187539ab9e22c0b"}
Jul 22 21:46:12.157654 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:12.157551    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-644efc-2xshk" event={"ID":"cb3add5e-7afe-4484-bd81-5f47487f7ebf","Type":"ContainerStarted","Data":"8ca0a98ea72be5dad81edb690315cf687cb31049fd2dd691218c265e3fd73ae5"}
Jul 22 21:46:12.173942 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:12.173893    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-644efc-2xshk" podStartSLOduration=1.173878694 podStartE2EDuration="1.173878694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:46:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:46:12.172626991 +0000 UTC m=+2970.196665572" watchObservedRunningTime="2026-07-22 21:46:12.173878694 +0000 UTC m=+2970.197917272"
Jul 22 21:46:13.163551 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:13.163508    2583 generic.go:356] "Generic (PLEG): container finished" podID="cb3add5e-7afe-4484-bd81-5f47487f7ebf" containerID="f193a59d5937aaebaca6d7446cf93c424785efcc4f2bc0883187539ab9e22c0b" exitCode=0
Jul 22 21:46:13.163957 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:13.163567    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-644efc-2xshk" event={"ID":"cb3add5e-7afe-4484-bd81-5f47487f7ebf","Type":"ContainerDied","Data":"f193a59d5937aaebaca6d7446cf93c424785efcc4f2bc0883187539ab9e22c0b"}
Jul 22 21:46:14.299969 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:14.299947    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-644efc-2xshk"
Jul 22 21:46:14.388574 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:14.388546    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb3add5e-7afe-4484-bd81-5f47487f7ebf-maas-api-service-ca\") pod \"cb3add5e-7afe-4484-bd81-5f47487f7ebf\" (UID: \"cb3add5e-7afe-4484-bd81-5f47487f7ebf\") "
Jul 22 21:46:14.388876 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:14.388856    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb3add5e-7afe-4484-bd81-5f47487f7ebf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cb3add5e-7afe-4484-bd81-5f47487f7ebf" (UID: "cb3add5e-7afe-4484-bd81-5f47487f7ebf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:46:14.490136 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:14.490065    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb3add5e-7afe-4484-bd81-5f47487f7ebf-maas-api-service-ca\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:46:15.174384 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:15.174359    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-644efc-2xshk"
Jul 22 21:46:15.174547 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:15.174352    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-644efc-2xshk" event={"ID":"cb3add5e-7afe-4484-bd81-5f47487f7ebf","Type":"ContainerDied","Data":"8ca0a98ea72be5dad81edb690315cf687cb31049fd2dd691218c265e3fd73ae5"}
Jul 22 21:46:15.174547 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:15.174489    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ca0a98ea72be5dad81edb690315cf687cb31049fd2dd691218c265e3fd73ae5"
Jul 22 21:46:26.532355 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:26.532316    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-644efc-2xshk"]
Jul 22 21:46:26.535051 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:26.535027    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-644efc-2xshk"]
Jul 22 21:46:28.409943 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:28.409904    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb3add5e-7afe-4484-bd81-5f47487f7ebf" path="/var/lib/kubelet/pods/cb3add5e-7afe-4484-bd81-5f47487f7ebf/volumes"
Jul 22 21:46:33.104685 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:33.104653    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"]
Jul 22 21:46:33.105171 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:33.104942    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv" podUID="228995b1-68ac-4b15-81ec-7627fcacfc89" containerName="istio-proxy" containerID="cri-o://aabb65c7166fc05169313b49107efbe56b3ce49a24914d1f5346c6f1dff6b238" gracePeriod=30
Jul 22 21:46:33.515074 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:33.514996    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bfd0ef-ssrbq"]
Jul 22 21:46:33.515368 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:33.515349    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb3add5e-7afe-4484-bd81-5f47487f7ebf" containerName="revoke-keys"
Jul 22 21:46:33.515368 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:33.515366    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb3add5e-7afe-4484-bd81-5f47487f7ebf" containerName="revoke-keys"
Jul 22 21:46:33.515523 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:33.515418    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb3add5e-7afe-4484-bd81-5f47487f7ebf" containerName="revoke-keys"
Jul 22 21:46:33.518400 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:33.518383    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bfd0ef-ssrbq"
Jul 22 21:46:33.520553 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:33.520534    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zz5vc\""
Jul 22 21:46:33.524898 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:33.524874    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bfd0ef-ssrbq"]
Jul 22 21:46:33.653376 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:33.653350    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ca1c80-e909-441b-af8b-8264db775bd8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-bfd0ef-ssrbq\" (UID: \"b4ca1c80-e909-441b-af8b-8264db775bd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bfd0ef-ssrbq"
Jul 22 21:46:33.754727 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:33.754702    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ca1c80-e909-441b-af8b-8264db775bd8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-bfd0ef-ssrbq\" (UID: \"b4ca1c80-e909-441b-af8b-8264db775bd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bfd0ef-ssrbq"
Jul 22 21:46:33.755316 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:33.755300    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ca1c80-e909-441b-af8b-8264db775bd8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-bfd0ef-ssrbq\" (UID: \"b4ca1c80-e909-441b-af8b-8264db775bd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bfd0ef-ssrbq"
Jul 22 21:46:33.829994 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:33.829941    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bfd0ef-ssrbq"
Jul 22 21:46:33.957434 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:33.957408    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bfd0ef-ssrbq"]
Jul 22 21:46:33.959663 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:46:33.959636    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4ca1c80_e909_441b_af8b_8264db775bd8.slice/crio-da12e1725de66bc1e69ae7f4161c5bf1bea872d895b222da0b487a80cee75b61 WatchSource:0}: Error finding container da12e1725de66bc1e69ae7f4161c5bf1bea872d895b222da0b487a80cee75b61: Status 404 returned error can't find the container with id da12e1725de66bc1e69ae7f4161c5bf1bea872d895b222da0b487a80cee75b61
Jul 22 21:46:34.261322 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:34.261290    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bfd0ef-ssrbq" event={"ID":"b4ca1c80-e909-441b-af8b-8264db775bd8","Type":"ContainerStarted","Data":"84f151db307cefad3a70d2842c12fb442913a363d76b34de13696c4b9920d4f8"}
Jul 22 21:46:34.261638 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:34.261343    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bfd0ef-ssrbq" event={"ID":"b4ca1c80-e909-441b-af8b-8264db775bd8","Type":"ContainerStarted","Data":"da12e1725de66bc1e69ae7f4161c5bf1bea872d895b222da0b487a80cee75b61"}
Jul 22 21:46:34.278320 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:34.278273    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bfd0ef-ssrbq" podStartSLOduration=1.278259558 podStartE2EDuration="1.278259558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:46:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:46:34.275887473 +0000 UTC m=+2992.299926051" watchObservedRunningTime="2026-07-22 21:46:34.278259558 +0000 UTC m=+2992.302298137"
Jul 22 21:46:35.266964 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:35.266931    2583 generic.go:356] "Generic (PLEG): container finished" podID="b4ca1c80-e909-441b-af8b-8264db775bd8" containerID="84f151db307cefad3a70d2842c12fb442913a363d76b34de13696c4b9920d4f8" exitCode=0
Jul 22 21:46:35.267399 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:35.266974    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bfd0ef-ssrbq" event={"ID":"b4ca1c80-e909-441b-af8b-8264db775bd8","Type":"ContainerDied","Data":"84f151db307cefad3a70d2842c12fb442913a363d76b34de13696c4b9920d4f8"}
Jul 22 21:46:36.395023 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:36.394998    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bfd0ef-ssrbq"
Jul 22 21:46:36.478649 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:36.478620    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ca1c80-e909-441b-af8b-8264db775bd8-maas-api-service-ca\") pod \"b4ca1c80-e909-441b-af8b-8264db775bd8\" (UID: \"b4ca1c80-e909-441b-af8b-8264db775bd8\") "
Jul 22 21:46:36.478952 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:36.478931    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4ca1c80-e909-441b-af8b-8264db775bd8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b4ca1c80-e909-441b-af8b-8264db775bd8" (UID: "b4ca1c80-e909-441b-af8b-8264db775bd8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:46:36.579331 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:36.579252    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ca1c80-e909-441b-af8b-8264db775bd8-maas-api-service-ca\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:46:36.843804 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:36.843767    2583 patch_prober.go:28] interesting pod/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 21:46:36.843949 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:36.843828    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv" podUID="228995b1-68ac-4b15-81ec-7627fcacfc89" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 21:46:37.277658 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:37.277588    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bfd0ef-ssrbq"
Jul 22 21:46:37.277658 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:37.277598    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bfd0ef-ssrbq" event={"ID":"b4ca1c80-e909-441b-af8b-8264db775bd8","Type":"ContainerDied","Data":"da12e1725de66bc1e69ae7f4161c5bf1bea872d895b222da0b487a80cee75b61"}
Jul 22 21:46:37.277658 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:37.277643    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da12e1725de66bc1e69ae7f4161c5bf1bea872d895b222da0b487a80cee75b61"
Jul 22 21:46:38.285820 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.285790    2583 generic.go:356] "Generic (PLEG): container finished" podID="228995b1-68ac-4b15-81ec-7627fcacfc89" containerID="aabb65c7166fc05169313b49107efbe56b3ce49a24914d1f5346c6f1dff6b238" exitCode=0
Jul 22 21:46:38.286174 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.285835    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv" event={"ID":"228995b1-68ac-4b15-81ec-7627fcacfc89","Type":"ContainerDied","Data":"aabb65c7166fc05169313b49107efbe56b3ce49a24914d1f5346c6f1dff6b238"}
Jul 22 21:46:38.286174 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.285897    2583 scope.go:117] "RemoveContainer" containerID="43251f9eb5aae14ffa1625051c596dee9af047a5fdf7c18529f7181d7a2902b4"
Jul 22 21:46:38.364880 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.364860    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:46:38.496458 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.496395    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/228995b1-68ac-4b15-81ec-7627fcacfc89-istiod-ca-cert\") pod \"228995b1-68ac-4b15-81ec-7627fcacfc89\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") "
Jul 22 21:46:38.496458 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.496445    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-workload-socket\") pod \"228995b1-68ac-4b15-81ec-7627fcacfc89\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") "
Jul 22 21:46:38.496599 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.496476    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/228995b1-68ac-4b15-81ec-7627fcacfc89-istio-podinfo\") pod \"228995b1-68ac-4b15-81ec-7627fcacfc89\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") "
Jul 22 21:46:38.496669 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.496646    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69688\" (UniqueName: \"kubernetes.io/projected/228995b1-68ac-4b15-81ec-7627fcacfc89-kube-api-access-69688\") pod \"228995b1-68ac-4b15-81ec-7627fcacfc89\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") "
Jul 22 21:46:38.496749 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.496725    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-istio-envoy\") pod \"228995b1-68ac-4b15-81ec-7627fcacfc89\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") "
Jul 22 21:46:38.496868 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.496764    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-credential-socket\") pod \"228995b1-68ac-4b15-81ec-7627fcacfc89\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") "
Jul 22 21:46:38.496868 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.496729    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "228995b1-68ac-4b15-81ec-7627fcacfc89" (UID: "228995b1-68ac-4b15-81ec-7627fcacfc89"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:46:38.496868 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.496781    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/228995b1-68ac-4b15-81ec-7627fcacfc89-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "228995b1-68ac-4b15-81ec-7627fcacfc89" (UID: "228995b1-68ac-4b15-81ec-7627fcacfc89"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:46:38.496868 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.496791    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-istio-data\") pod \"228995b1-68ac-4b15-81ec-7627fcacfc89\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") "
Jul 22 21:46:38.497144 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.496882    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/228995b1-68ac-4b15-81ec-7627fcacfc89-istio-token\") pod \"228995b1-68ac-4b15-81ec-7627fcacfc89\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") "
Jul 22 21:46:38.497144 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.496914    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-workload-certs\") pod \"228995b1-68ac-4b15-81ec-7627fcacfc89\" (UID: \"228995b1-68ac-4b15-81ec-7627fcacfc89\") "
Jul 22 21:46:38.497144 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.497068    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "228995b1-68ac-4b15-81ec-7627fcacfc89" (UID: "228995b1-68ac-4b15-81ec-7627fcacfc89"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:46:38.497318 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.497294    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-credential-socket\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:46:38.497553 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.497317    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/228995b1-68ac-4b15-81ec-7627fcacfc89-istiod-ca-cert\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:46:38.497553 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.497332    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-workload-socket\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:46:38.497553 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.497417    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "228995b1-68ac-4b15-81ec-7627fcacfc89" (UID: "228995b1-68ac-4b15-81ec-7627fcacfc89"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:46:38.497782 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.497759    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-istio-data" (OuterVolumeSpecName: "istio-data") pod "228995b1-68ac-4b15-81ec-7627fcacfc89" (UID: "228995b1-68ac-4b15-81ec-7627fcacfc89"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:46:38.499069 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.499045    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "228995b1-68ac-4b15-81ec-7627fcacfc89" (UID: "228995b1-68ac-4b15-81ec-7627fcacfc89"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:46:38.499472 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.499451    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/228995b1-68ac-4b15-81ec-7627fcacfc89-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "228995b1-68ac-4b15-81ec-7627fcacfc89" (UID: "228995b1-68ac-4b15-81ec-7627fcacfc89"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 21:46:38.499472 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.499455    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/228995b1-68ac-4b15-81ec-7627fcacfc89-kube-api-access-69688" (OuterVolumeSpecName: "kube-api-access-69688") pod "228995b1-68ac-4b15-81ec-7627fcacfc89" (UID: "228995b1-68ac-4b15-81ec-7627fcacfc89"). InnerVolumeSpecName "kube-api-access-69688". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:46:38.499580 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.499463    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/228995b1-68ac-4b15-81ec-7627fcacfc89-istio-token" (OuterVolumeSpecName: "istio-token") pod "228995b1-68ac-4b15-81ec-7627fcacfc89" (UID: "228995b1-68ac-4b15-81ec-7627fcacfc89"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:46:38.598077 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.598054    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-istio-envoy\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:46:38.598077 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.598075    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-istio-data\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:46:38.598221 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.598083    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/228995b1-68ac-4b15-81ec-7627fcacfc89-istio-token\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:46:38.598221 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.598091    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/228995b1-68ac-4b15-81ec-7627fcacfc89-workload-certs\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:46:38.598221 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.598099    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/228995b1-68ac-4b15-81ec-7627fcacfc89-istio-podinfo\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:46:38.598221 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:38.598126    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69688\" (UniqueName: \"kubernetes.io/projected/228995b1-68ac-4b15-81ec-7627fcacfc89-kube-api-access-69688\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:46:39.291701 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:39.291662    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv" event={"ID":"228995b1-68ac-4b15-81ec-7627fcacfc89","Type":"ContainerDied","Data":"adc163bdfe088526e1d05c92a3f7c6353392cec8b8f145c1dd31a3979d52212a"}
Jul 22 21:46:39.292098 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:39.291746    2583 scope.go:117] "RemoveContainer" containerID="aabb65c7166fc05169313b49107efbe56b3ce49a24914d1f5346c6f1dff6b238"
Jul 22 21:46:39.292098 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:39.291681    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"
Jul 22 21:46:39.314228 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:39.314198    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"]
Jul 22 21:46:39.318320 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:39.318295    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-644efc-openshift-default-76b885ccff-q5bpv"]
Jul 22 21:46:40.409376 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:40.409341    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="228995b1-68ac-4b15-81ec-7627fcacfc89" path="/var/lib/kubelet/pods/228995b1-68ac-4b15-81ec-7627fcacfc89/volumes"
Jul 22 21:46:48.590219 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:48.590185    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bfd0ef-ssrbq"]
Jul 22 21:46:48.592454 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:48.592430    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bfd0ef-ssrbq"]
Jul 22 21:46:50.410959 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:50.410923    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4ca1c80-e909-441b-af8b-8264db775bd8" path="/var/lib/kubelet/pods/b4ca1c80-e909-441b-af8b-8264db775bd8/volumes"
Jul 22 21:46:55.105853 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:55.105812    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"]
Jul 22 21:46:55.106297 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:46:55.106017    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs" podUID="b2e33d87-8468-4129-8742-b91608ebdae8" containerName="istio-proxy" containerID="cri-o://d23495a6678efd6a2c9ffe5345dc137c198737eedccf82e3a35d3aff113ab76f" gracePeriod=30
Jul 22 21:47:00.355278 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.355254    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:47:00.395699 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.395633    2583 generic.go:356] "Generic (PLEG): container finished" podID="b2e33d87-8468-4129-8742-b91608ebdae8" containerID="d23495a6678efd6a2c9ffe5345dc137c198737eedccf82e3a35d3aff113ab76f" exitCode=0
Jul 22 21:47:00.395699 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.395667    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs" event={"ID":"b2e33d87-8468-4129-8742-b91608ebdae8","Type":"ContainerDied","Data":"d23495a6678efd6a2c9ffe5345dc137c198737eedccf82e3a35d3aff113ab76f"}
Jul 22 21:47:00.395699 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.395682    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"
Jul 22 21:47:00.395900 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.395703    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs" event={"ID":"b2e33d87-8468-4129-8742-b91608ebdae8","Type":"ContainerDied","Data":"ed70dcf00c453015531e560425164641713e119752493aca77e7eb6cacc6d7f1"}
Jul 22 21:47:00.395900 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.395724    2583 scope.go:117] "RemoveContainer" containerID="d23495a6678efd6a2c9ffe5345dc137c198737eedccf82e3a35d3aff113ab76f"
Jul 22 21:47:00.403970 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.403952    2583 scope.go:117] "RemoveContainer" containerID="3af85b2d159e1334357aeb1e9a798d314b0cf19a9789b5a2e7f78cbc8e8a6756"
Jul 22 21:47:00.412240 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.412223    2583 scope.go:117] "RemoveContainer" containerID="d23495a6678efd6a2c9ffe5345dc137c198737eedccf82e3a35d3aff113ab76f"
Jul 22 21:47:00.412505 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:47:00.412487    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d23495a6678efd6a2c9ffe5345dc137c198737eedccf82e3a35d3aff113ab76f\": container with ID starting with d23495a6678efd6a2c9ffe5345dc137c198737eedccf82e3a35d3aff113ab76f not found: ID does not exist" containerID="d23495a6678efd6a2c9ffe5345dc137c198737eedccf82e3a35d3aff113ab76f"
Jul 22 21:47:00.412563 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.412512    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d23495a6678efd6a2c9ffe5345dc137c198737eedccf82e3a35d3aff113ab76f"} err="failed to get container status \"d23495a6678efd6a2c9ffe5345dc137c198737eedccf82e3a35d3aff113ab76f\": rpc error: code = NotFound desc = could not find container \"d23495a6678efd6a2c9ffe5345dc137c198737eedccf82e3a35d3aff113ab76f\": container with ID starting with d23495a6678efd6a2c9ffe5345dc137c198737eedccf82e3a35d3aff113ab76f not found: ID does not exist"
Jul 22 21:47:00.412563 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.412531    2583 scope.go:117] "RemoveContainer" containerID="3af85b2d159e1334357aeb1e9a798d314b0cf19a9789b5a2e7f78cbc8e8a6756"
Jul 22 21:47:00.412750 ip-10-0-133-4 kubenswrapper[2583]: E0722 21:47:00.412732    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3af85b2d159e1334357aeb1e9a798d314b0cf19a9789b5a2e7f78cbc8e8a6756\": container with ID starting with 3af85b2d159e1334357aeb1e9a798d314b0cf19a9789b5a2e7f78cbc8e8a6756 not found: ID does not exist" containerID="3af85b2d159e1334357aeb1e9a798d314b0cf19a9789b5a2e7f78cbc8e8a6756"
Jul 22 21:47:00.412805 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.412759    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3af85b2d159e1334357aeb1e9a798d314b0cf19a9789b5a2e7f78cbc8e8a6756"} err="failed to get container status \"3af85b2d159e1334357aeb1e9a798d314b0cf19a9789b5a2e7f78cbc8e8a6756\": rpc error: code = NotFound desc = could not find container \"3af85b2d159e1334357aeb1e9a798d314b0cf19a9789b5a2e7f78cbc8e8a6756\": container with ID starting with 3af85b2d159e1334357aeb1e9a798d314b0cf19a9789b5a2e7f78cbc8e8a6756 not found: ID does not exist"
Jul 22 21:47:00.474455 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.474424    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwt7b\" (UniqueName: \"kubernetes.io/projected/b2e33d87-8468-4129-8742-b91608ebdae8-kube-api-access-wwt7b\") pod \"b2e33d87-8468-4129-8742-b91608ebdae8\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") "
Jul 22 21:47:00.474455 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.474456    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2e33d87-8468-4129-8742-b91608ebdae8-istiod-ca-cert\") pod \"b2e33d87-8468-4129-8742-b91608ebdae8\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") "
Jul 22 21:47:00.474626 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.474476    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-workload-socket\") pod \"b2e33d87-8468-4129-8742-b91608ebdae8\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") "
Jul 22 21:47:00.474626 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.474494    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-istio-envoy\") pod \"b2e33d87-8468-4129-8742-b91608ebdae8\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") "
Jul 22 21:47:00.474626 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.474531    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-workload-certs\") pod \"b2e33d87-8468-4129-8742-b91608ebdae8\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") "
Jul 22 21:47:00.474626 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.474556    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-credential-socket\") pod \"b2e33d87-8468-4129-8742-b91608ebdae8\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") "
Jul 22 21:47:00.474626 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.474588    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-istio-data\") pod \"b2e33d87-8468-4129-8742-b91608ebdae8\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") "
Jul 22 21:47:00.474861 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.474639    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2e33d87-8468-4129-8742-b91608ebdae8-istio-token\") pod \"b2e33d87-8468-4129-8742-b91608ebdae8\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") "
Jul 22 21:47:00.474861 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.474700    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2e33d87-8468-4129-8742-b91608ebdae8-istio-podinfo\") pod \"b2e33d87-8468-4129-8742-b91608ebdae8\" (UID: \"b2e33d87-8468-4129-8742-b91608ebdae8\") "
Jul 22 21:47:00.474861 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.474730    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b2e33d87-8468-4129-8742-b91608ebdae8" (UID: "b2e33d87-8468-4129-8742-b91608ebdae8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:47:00.475018 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.474912    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b2e33d87-8468-4129-8742-b91608ebdae8" (UID: "b2e33d87-8468-4129-8742-b91608ebdae8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:47:00.475018 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.474917    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2e33d87-8468-4129-8742-b91608ebdae8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b2e33d87-8468-4129-8742-b91608ebdae8" (UID: "b2e33d87-8468-4129-8742-b91608ebdae8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:47:00.475163 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.475143    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b2e33d87-8468-4129-8742-b91608ebdae8" (UID: "b2e33d87-8468-4129-8742-b91608ebdae8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:47:00.475831 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.475798    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-istio-data" (OuterVolumeSpecName: "istio-data") pod "b2e33d87-8468-4129-8742-b91608ebdae8" (UID: "b2e33d87-8468-4129-8742-b91608ebdae8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:47:00.476448 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.476424    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2e33d87-8468-4129-8742-b91608ebdae8-istiod-ca-cert\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:47:00.476560 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.476451    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-workload-socket\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:47:00.476560 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.476465    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-workload-certs\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:47:00.476560 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.476477    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-credential-socket\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:47:00.476560 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.476489    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-istio-data\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:47:00.477126 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.477072    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2e33d87-8468-4129-8742-b91608ebdae8-kube-api-access-wwt7b" (OuterVolumeSpecName: "kube-api-access-wwt7b") pod "b2e33d87-8468-4129-8742-b91608ebdae8" (UID: "b2e33d87-8468-4129-8742-b91608ebdae8"). InnerVolumeSpecName "kube-api-access-wwt7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:47:00.477234 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.477217    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2e33d87-8468-4129-8742-b91608ebdae8-istio-token" (OuterVolumeSpecName: "istio-token") pod "b2e33d87-8468-4129-8742-b91608ebdae8" (UID: "b2e33d87-8468-4129-8742-b91608ebdae8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:47:00.477338 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.477312    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b2e33d87-8468-4129-8742-b91608ebdae8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b2e33d87-8468-4129-8742-b91608ebdae8" (UID: "b2e33d87-8468-4129-8742-b91608ebdae8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 21:47:00.478072 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.478051    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b2e33d87-8468-4129-8742-b91608ebdae8" (UID: "b2e33d87-8468-4129-8742-b91608ebdae8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:47:00.577451 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.577427    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2e33d87-8468-4129-8742-b91608ebdae8-istio-podinfo\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:47:00.577451 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.577448    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwt7b\" (UniqueName: \"kubernetes.io/projected/b2e33d87-8468-4129-8742-b91608ebdae8-kube-api-access-wwt7b\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:47:00.577590 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.577457    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2e33d87-8468-4129-8742-b91608ebdae8-istio-envoy\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:47:00.577590 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.577466    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2e33d87-8468-4129-8742-b91608ebdae8-istio-token\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\""
Jul 22 21:47:00.717153 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.717125    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"]
Jul 22 21:47:00.722933 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:00.722910    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-bfd0ef-openshift-default-7f679dcff9-zn7bs"]
Jul 22 21:47:02.207473 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:02.207443    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846644596-zq5z2_03a5a90c-3d48-4dff-98a4-75a9d2d9391a/copy-manifests/0.log"
Jul 22 21:47:02.227289 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:02.227253    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846644596-zq5z2_03a5a90c-3d48-4dff-98a4-75a9d2d9391a/manager/0.log"
Jul 22 21:47:02.410117 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:02.410089    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2e33d87-8468-4129-8742-b91608ebdae8" path="/var/lib/kubelet/pods/b2e33d87-8468-4129-8742-b91608ebdae8/volumes"
Jul 22 21:47:02.717221 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:02.717194    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29745915-7fmnv_ca034350-9cc3-4cab-80c7-ecfcbea07a38/cleanup/0.log"
Jul 22 21:47:03.044570 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:03.044498    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-ph9tg_21de62a3-c7ff-45e1-9daf-d0aec4a8c07c/postgres/0.log"
Jul 22 21:47:04.668619 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:04.668586    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-npgfq_f2ce38d0-2d24-4091-b127-55158509990b/kuadrant-console-plugin/0.log"
Jul 22 21:47:05.728326 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:05.728291    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6766dd8-5shbm_de31647a-861d-4587-b2d8-3845d6da0843/kube-auth-proxy/0.log"
Jul 22 21:47:06.645588 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:06.645558    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-zrpw7_ecd14ed9-d96b-4d91-9af4-4d43a9528c9f/main/0.log"
Jul 22 21:47:06.995131 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:06.995030    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4gckh_7699092c-5e21-4c3f-b5dc-dae25066f291/main/0.log"
Jul 22 21:47:07.226851 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:07.226821    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-45ql5_4e56549b-599f-4681-9653-f22fa7947fba/main/0.log"
Jul 22 21:47:15.919329 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:15.919298    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-84495_091e389d-9d92-429c-a165-cf119fbfa842/global-pull-secret-syncer/0.log"
Jul 22 21:47:16.089632 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:16.089602    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mhtkv_d8ee72b3-bea8-4a9a-8254-8bf3ed035489/konnectivity-agent/0.log"
Jul 22 21:47:16.171274 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:16.171208    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-4.ec2.internal_ee01c9b5f7069f2b2a4c40086f314e75/haproxy/0.log"
Jul 22 21:47:22.200333 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:22.200311    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-npgfq_f2ce38d0-2d24-4091-b127-55158509990b/kuadrant-console-plugin/0.log"
Jul 22 21:47:24.104302 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:24.104272    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_46c69bc0-1847-4417-99a7-dc8401fd003f/alertmanager/0.log"
Jul 22 21:47:24.126676 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:24.126655    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_46c69bc0-1847-4417-99a7-dc8401fd003f/config-reloader/0.log"
Jul 22 21:47:24.146472 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:24.146449    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_46c69bc0-1847-4417-99a7-dc8401fd003f/kube-rbac-proxy-web/0.log"
Jul 22 21:47:24.166908 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:24.166887    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_46c69bc0-1847-4417-99a7-dc8401fd003f/kube-rbac-proxy/0.log"
Jul 22 21:47:24.192017 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:24.191997    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_46c69bc0-1847-4417-99a7-dc8401fd003f/kube-rbac-proxy-metric/0.log"
Jul 22 21:47:24.212240 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:24.212208    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_46c69bc0-1847-4417-99a7-dc8401fd003f/prom-label-proxy/0.log"
Jul 22 21:47:24.233402 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:24.233385    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_46c69bc0-1847-4417-99a7-dc8401fd003f/init-config-reloader/0.log"
Jul 22 21:47:24.623612 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:24.623588    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fgq9c_06e3409a-e7b4-452b-a0c8-97adec942f68/node-exporter/0.log"
Jul 22 21:47:24.643849 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:24.643824    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fgq9c_06e3409a-e7b4-452b-a0c8-97adec942f68/kube-rbac-proxy/0.log"
Jul 22 21:47:24.665956 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:24.665935    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fgq9c_06e3409a-e7b4-452b-a0c8-97adec942f68/init-textfile/0.log"
Jul 22 21:47:24.786179 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:24.786099    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b91b3bd-ee9c-4512-b628-cb2c877df4af/prometheus/0.log"
Jul 22 21:47:24.805244 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:24.805225    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b91b3bd-ee9c-4512-b628-cb2c877df4af/config-reloader/0.log"
Jul 22 21:47:24.826906 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:24.826887    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b91b3bd-ee9c-4512-b628-cb2c877df4af/thanos-sidecar/0.log"
Jul 22 21:47:24.846972 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:24.846952    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b91b3bd-ee9c-4512-b628-cb2c877df4af/kube-rbac-proxy-web/0.log"
Jul 22 21:47:24.867012 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:24.866993    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b91b3bd-ee9c-4512-b628-cb2c877df4af/kube-rbac-proxy/0.log"
Jul 22 21:47:24.888716 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:24.888699    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b91b3bd-ee9c-4512-b628-cb2c877df4af/kube-rbac-proxy-thanos/0.log"
Jul 22 21:47:24.910731 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:24.910710    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b91b3bd-ee9c-4512-b628-cb2c877df4af/init-config-reloader/0.log"
Jul 22 21:47:25.017147 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:25.017127    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-868bdd678-9dxmf_76fa3d85-1682-4f5e-baf1-fa5f45a3e791/telemeter-client/0.log"
Jul 22 21:47:25.037599 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:25.037542    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-868bdd678-9dxmf_76fa3d85-1682-4f5e-baf1-fa5f45a3e791/reload/0.log"
Jul 22 21:47:25.057180 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:25.057162    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-868bdd678-9dxmf_76fa3d85-1682-4f5e-baf1-fa5f45a3e791/kube-rbac-proxy/0.log"
Jul 22 21:47:26.354696 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.354661    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2"]
Jul 22 21:47:26.355207 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.355172    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ca1c80-e909-441b-af8b-8264db775bd8" containerName="revoke-keys"
Jul 22 21:47:26.355207 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.355190    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ca1c80-e909-441b-af8b-8264db775bd8" containerName="revoke-keys"
Jul 22 21:47:26.355207 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.355206    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="228995b1-68ac-4b15-81ec-7627fcacfc89" containerName="istio-proxy"
Jul 22 21:47:26.355385 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.355215    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="228995b1-68ac-4b15-81ec-7627fcacfc89" containerName="istio-proxy"
Jul 22 21:47:26.355385 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.355229    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="228995b1-68ac-4b15-81ec-7627fcacfc89" containerName="istio-proxy"
Jul 22 21:47:26.355385 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.355237    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="228995b1-68ac-4b15-81ec-7627fcacfc89" containerName="istio-proxy"
Jul 22 21:47:26.355385 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.355259    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2e33d87-8468-4129-8742-b91608ebdae8" containerName="istio-proxy"
Jul 22 21:47:26.355385 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.355269    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2e33d87-8468-4129-8742-b91608ebdae8" containerName="istio-proxy"
Jul 22 21:47:26.355385 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.355283    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2e33d87-8468-4129-8742-b91608ebdae8" containerName="istio-proxy"
Jul 22 21:47:26.355385 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.355291    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2e33d87-8468-4129-8742-b91608ebdae8" containerName="istio-proxy"
Jul 22 21:47:26.355385 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.355371    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2e33d87-8468-4129-8742-b91608ebdae8" containerName="istio-proxy"
Jul 22 21:47:26.355385 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.355383    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="228995b1-68ac-4b15-81ec-7627fcacfc89" containerName="istio-proxy"
Jul 22 21:47:26.355997 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.355393    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2e33d87-8468-4129-8742-b91608ebdae8" containerName="istio-proxy"
Jul 22 21:47:26.355997 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.355404    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="228995b1-68ac-4b15-81ec-7627fcacfc89" containerName="istio-proxy"
Jul 22 21:47:26.355997 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.355412    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4ca1c80-e909-441b-af8b-8264db775bd8" containerName="revoke-keys"
Jul 22 21:47:26.358919 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.358901    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2"
Jul 22 21:47:26.361058 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.361039    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rv7sd\"/\"kube-root-ca.crt\""
Jul 22 21:47:26.361932 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.361900    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rv7sd\"/\"openshift-service-ca.crt\""
Jul 22 21:47:26.362010 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.361900    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rv7sd\"/\"default-dockercfg-cpdmh\""
Jul 22 21:47:26.366945 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.366926    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2"]
Jul 22 21:47:26.378726 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.378708    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-5mn24_c0af42d4-27c6-437d-9fdf-06f88118e432/networking-console-plugin/0.log"
Jul 22 21:47:26.490151 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.490127    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwng7\" (UniqueName: \"kubernetes.io/projected/be316bc7-3a53-4912-8849-27fcd1c89654-kube-api-access-hwng7\") pod \"perf-node-gather-daemonset-g66g2\" (UID: \"be316bc7-3a53-4912-8849-27fcd1c89654\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2"
Jul 22 21:47:26.490252 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.490163    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be316bc7-3a53-4912-8849-27fcd1c89654-lib-modules\") pod \"perf-node-gather-daemonset-g66g2\" (UID: \"be316bc7-3a53-4912-8849-27fcd1c89654\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2"
Jul 22 21:47:26.490252 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.490183    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be316bc7-3a53-4912-8849-27fcd1c89654-sys\") pod \"perf-node-gather-daemonset-g66g2\" (UID: \"be316bc7-3a53-4912-8849-27fcd1c89654\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2"
Jul 22 21:47:26.490356 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.490270    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/be316bc7-3a53-4912-8849-27fcd1c89654-proc\") pod \"perf-node-gather-daemonset-g66g2\" (UID: \"be316bc7-3a53-4912-8849-27fcd1c89654\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2"
Jul 22 21:47:26.490409 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.490353    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/be316bc7-3a53-4912-8849-27fcd1c89654-podres\") pod \"perf-node-gather-daemonset-g66g2\" (UID: \"be316bc7-3a53-4912-8849-27fcd1c89654\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2"
Jul 22 21:47:26.591632 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.591609    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwng7\" (UniqueName: \"kubernetes.io/projected/be316bc7-3a53-4912-8849-27fcd1c89654-kube-api-access-hwng7\") pod \"perf-node-gather-daemonset-g66g2\" (UID: \"be316bc7-3a53-4912-8849-27fcd1c89654\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2"
Jul 22 21:47:26.591748 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.591671    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be316bc7-3a53-4912-8849-27fcd1c89654-lib-modules\") pod \"perf-node-gather-daemonset-g66g2\" (UID: \"be316bc7-3a53-4912-8849-27fcd1c89654\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2"
Jul 22 21:47:26.591748 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.591699    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be316bc7-3a53-4912-8849-27fcd1c89654-sys\") pod \"perf-node-gather-daemonset-g66g2\" (UID: \"be316bc7-3a53-4912-8849-27fcd1c89654\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2"
Jul 22 21:47:26.591864 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.591755    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/be316bc7-3a53-4912-8849-27fcd1c89654-proc\") pod \"perf-node-gather-daemonset-g66g2\" (UID: \"be316bc7-3a53-4912-8849-27fcd1c89654\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2"
Jul 22 21:47:26.591864 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.591792    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/be316bc7-3a53-4912-8849-27fcd1c89654-podres\") pod \"perf-node-gather-daemonset-g66g2\" (UID: \"be316bc7-3a53-4912-8849-27fcd1c89654\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2"
Jul 22 21:47:26.591864 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.591802    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be316bc7-3a53-4912-8849-27fcd1c89654-sys\") pod \"perf-node-gather-daemonset-g66g2\" (UID: \"be316bc7-3a53-4912-8849-27fcd1c89654\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2"
Jul 22 21:47:26.591989 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.591856    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be316bc7-3a53-4912-8849-27fcd1c89654-lib-modules\") pod \"perf-node-gather-daemonset-g66g2\" (UID: \"be316bc7-3a53-4912-8849-27fcd1c89654\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2"
Jul 22 21:47:26.591989 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.591899    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/be316bc7-3a53-4912-8849-27fcd1c89654-proc\") pod \"perf-node-gather-daemonset-g66g2\" (UID: \"be316bc7-3a53-4912-8849-27fcd1c89654\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2"
Jul 22 21:47:26.591989 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.591930    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/be316bc7-3a53-4912-8849-27fcd1c89654-podres\") pod \"perf-node-gather-daemonset-g66g2\" (UID: \"be316bc7-3a53-4912-8849-27fcd1c89654\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2"
Jul 22 21:47:26.599300 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.599285    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwng7\" (UniqueName: \"kubernetes.io/projected/be316bc7-3a53-4912-8849-27fcd1c89654-kube-api-access-hwng7\") pod \"perf-node-gather-daemonset-g66g2\" (UID: \"be316bc7-3a53-4912-8849-27fcd1c89654\") " pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2"
Jul 22 21:47:26.669511 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.669454    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2"
Jul 22 21:47:26.795150 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:26.795127    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2"]
Jul 22 21:47:26.797296 ip-10-0-133-4 kubenswrapper[2583]: W0722 21:47:26.797263    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbe316bc7_3a53_4912_8849_27fcd1c89654.slice/crio-8e1e196ef6cd2f924b79d7fc504ae6d5df9906deac3effdfad7035bf297b5009 WatchSource:0}: Error finding container 8e1e196ef6cd2f924b79d7fc504ae6d5df9906deac3effdfad7035bf297b5009: Status 404 returned error can't find the container with id 8e1e196ef6cd2f924b79d7fc504ae6d5df9906deac3effdfad7035bf297b5009
Jul 22 21:47:27.521158 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:27.521123    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2" event={"ID":"be316bc7-3a53-4912-8849-27fcd1c89654","Type":"ContainerStarted","Data":"12db0c843ded3992c7ebbade117930e639565eaae8d2aec0ea1be0e900372bd1"}
Jul 22 21:47:27.521559 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:27.521175    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2" event={"ID":"be316bc7-3a53-4912-8849-27fcd1c89654","Type":"ContainerStarted","Data":"8e1e196ef6cd2f924b79d7fc504ae6d5df9906deac3effdfad7035bf297b5009"}
Jul 22 21:47:27.521559 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:27.521223    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2"
Jul 22 21:47:27.536641 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:27.536597    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2" podStartSLOduration=1.536582968 podStartE2EDuration="1.536582968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:47:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:47:27.534810178 +0000 UTC m=+3045.558848756" watchObservedRunningTime="2026-07-22 21:47:27.536582968 +0000 UTC m=+3045.560621562"
Jul 22 21:47:29.249811 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:29.249783    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4bw2q_3c68b0c1-3f71-40fe-b12a-1122487bfec5/dns/0.log"
Jul 22 21:47:29.269190 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:29.269171    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4bw2q_3c68b0c1-3f71-40fe-b12a-1122487bfec5/kube-rbac-proxy/0.log"
Jul 22 21:47:29.407361 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:29.407339    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dfp6m_3c52e7ef-2939-4ccc-9b94-ad30fe6e6a15/dns-node-resolver/0.log"
Jul 22 21:47:30.012505 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:30.012479    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c297s_9b14274a-0241-464a-876e-a6ec2f7c8d9e/node-ca/0.log"
Jul 22 21:47:31.089498 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:31.089464    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6766dd8-5shbm_de31647a-861d-4587-b2d8-3845d6da0843/kube-auth-proxy/0.log"
Jul 22 21:47:31.931059 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:31.931011    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j2zwd_06dcf1b9-ea23-4842-8fcc-a5e8295407df/serve-healthcheck-canary/0.log"
Jul 22 21:47:32.508571 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:32.508539    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-872zt_9969fddd-5eb8-4fd1-9ae9-089741d40478/kube-rbac-proxy/0.log"
Jul 22 21:47:32.534574 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:32.534547    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-872zt_9969fddd-5eb8-4fd1-9ae9-089741d40478/exporter/0.log"
Jul 22 21:47:32.559855 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:32.559828    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-872zt_9969fddd-5eb8-4fd1-9ae9-089741d40478/extractor/0.log"
Jul 22 21:47:33.535983 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:33.535908    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rv7sd/perf-node-gather-daemonset-g66g2"
Jul 22 21:47:35.450171 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:35.450143    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846644596-zq5z2_03a5a90c-3d48-4dff-98a4-75a9d2d9391a/manager/0.log"
Jul 22 21:47:35.467861 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:35.467843    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846644596-zq5z2_03a5a90c-3d48-4dff-98a4-75a9d2d9391a/copy-manifests/0.log"
Jul 22 21:47:36.906177 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:36.906142    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7dc9694985-gdq6j_70f3d772-d945-4fa4-84c9-e4eb77720dff/manager/0.log"
Jul 22 21:47:37.743189 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:37.743160    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6766dd8-5shbm_de31647a-861d-4587-b2d8-3845d6da0843/kube-auth-proxy/0.log"
Jul 22 21:47:39.213813 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:39.213775    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6766dd8-5shbm_de31647a-861d-4587-b2d8-3845d6da0843/kube-auth-proxy/0.log"
Jul 22 21:47:43.424160 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:43.424133    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tw8rc_1b1bf362-79df-4816-848b-b825bde19b3e/kube-multus-additional-cni-plugins/0.log"
Jul 22 21:47:43.447332 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:43.447309    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tw8rc_1b1bf362-79df-4816-848b-b825bde19b3e/egress-router-binary-copy/0.log"
Jul 22 21:47:43.468816 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:43.468798    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tw8rc_1b1bf362-79df-4816-848b-b825bde19b3e/cni-plugins/0.log"
Jul 22 21:47:43.488709 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:43.488685    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tw8rc_1b1bf362-79df-4816-848b-b825bde19b3e/bond-cni-plugin/0.log"
Jul 22 21:47:43.508145 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:43.508100    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tw8rc_1b1bf362-79df-4816-848b-b825bde19b3e/routeoverride-cni/0.log"
Jul 22 21:47:43.528401 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:43.528379    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tw8rc_1b1bf362-79df-4816-848b-b825bde19b3e/whereabouts-cni-bincopy/0.log"
Jul 22 21:47:43.548484 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:43.548467    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tw8rc_1b1bf362-79df-4816-848b-b825bde19b3e/whereabouts-cni/0.log"
Jul 22 21:47:43.805648 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:43.805571    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xmq4c_80f40282-865b-4237-9192-0343b966ab60/kube-multus/0.log"
Jul 22 21:47:43.923831 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:43.923804    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f6h54_e32f596b-8ead-471c-8e23-92b5816c3cd9/network-metrics-daemon/0.log"
Jul 22 21:47:43.940404 ip-10-0-133-4 kubenswrapper[2583]: I0722 21:47:43.940380    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f6h54_e32f596b-8ead-471c-8e23-92b5816c3cd9/kube-rbac-proxy/0.log"